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(54) ELECTRONIC PET SYSTEM, NETWORK SYSTEM, ROBOT, AND STORAGE MEDIUM 

(57) This invention enables realization of an elec- 
tronic pet with more reality using various types of 
devices. 

Specifically, a virtual electronic pet 202 and a pet- 
type robot 204 change the state of the emotion and the 
state of the instinct as the internal state of the electronic 
pet (information included in pet characteristic informa- 
tion 203) in accordance with surrounding information 
and internal information, and act in accordance with the 
state of the emotion and the state of the instinct. Trans- 
mission/reception of the internal state of the electronic 
pet (pet characteristic information 203) is made possible 
among the virtual electronic pet 202, the pet-type robot 
204, and a personal computer 201 . Thus, the action of 
the electronic pet is implemented by each device in 
accordance with the internal state of the electronic pet 
changed by another equipment. 
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Description 

Technical Field 

[0001] This invention relates to an electronic pet 
system, a network system, a robot, and a storage 
medium, and particularly to an electronic pet system, a 
network system, a robot, and a storage medium which 
enable realization of an electronic pet in various types of 
devices. 

Background Art 

[0002] Recently, so-called electronic pet devices (or 
breeding simulation game machines) have been popu- 
lar because of the easiness in comparison with breed- 
ing of real animals as pets. 

[0003] In an electronic pet device, an object of a vir- 
tual living body is displayed as an electronic pet and a 
keeper (user of the electronic pet device) is notified of 
the state of the electronic pet such as the degree of star- 
vation (hunger) or fatigue by an image or a sound. The 
keeper (user) feeds or plays with the electronic pet by 
operating the electronic pet device in accordance with 
the state of the electronic pet. Thus, the electronic pet 
has its state (state of the electronic pet) changed on the 
basis of the keeper's actions and is thus bred. The elec- 
tronic pet grows with the lapse of time and therefore the 
state of the electronic pet is also changed with the lapse 
of time. 

[0004] Meanwhile, since the electronic pet device 
only displays the electronic pet on the display screen, 
the displayed electronic pet is a so-called virtual exist- 
ence. 

[0005] In the case where the electronic pet is real- 
ized by means of, for example, a robot, which exists as 
a substance, the robot as the electronic pet actually 
exists in the real world. In such a case, with respect to 
the robot as the electronic pet, the keeper (user) will 
have a feeling closer to the feeling in the case of actually 
breeding a pet, than with the electronic pet displayed in 
the electronic pet device. 

[0006] However, in the case where the electronic 
pet is realized by means of a robot, it is inconvenient to 
carry the robot in traveling or the like. Therefore, it is 
more convenient if the electronic pet can be realized as 
an actually existing robot in a certain case and can be 
realized as a virtual existence in a portable electronic 
pet device in another case. 

[0007] Since the electronic pet realized in the con- 
ventional electronic pet device generally has its state 
changed in accordance with an input from the user or 
with the lapse of time and thus takes an action, it lacks 
reality in comparison with the case of breeding a real 
animal as a pet. 

[0008] Specifically, for example, in the case where a 
dog as a real animal is bred as a pet, when the dog 
wants the keeper to play with him, the dog barks or 



wags his tail to draw the keeper's attention. In this case, 
if the keeper keeps ignoring, the dog gets tired and 
stops barking or wagging his tail and then takes an 
action such as falling asleep. The real pet animal may 

5 be in high spirits after sleeping. 

[0009] On the other hand, the electronic pet real- 
ized in the conventional electronic pet device (for exam- 
ple, an electronic pet dog) continues barking orwagging 
its tail when wanting the keeper to piay, or stops such an 

10 action due to the lapse of time. Unlike the real pet ani- 
mal (for example, a dog), the electronic pet does not get 
tired and fall asleep through barking orwagging its tail. 
That is, in the electronic pet realized in the conventional 
electronic pet device, the state of the electronic pet is 

is not changed in accordance with the action of the elec- 
tronic pet itself, and therefore does not take any action 
in accordance with such a change of the state due to the 
action of the electronic pet itself. For these reasons, it is 
demanded to provide an electronic pet with more reality. 

20 

Disclosure of the Invention 

[0010] In view of the foregoing status of the art, it is 
an object of the present invention to provide an elec- 
ts tronic pet system, a network system, a robot, and a stor- 
age medium which enable realization of an electronic 
pet with more reality in various types of devices. 
[0011] Specifically, an electronic pet system 
according to the present invention has an information 
30 processing device and a robot. The information 
processing device has transmission/reception means 
capable of transmitting and receiving the internal state 
of an electronic pet, which is changed in accordance 
with input information and is information for causing the 
35 electronic petto act, and image display means, and car- 
ries out processing for implementing the electronic pet 
by the image display means. The robot has transmis- 
sion/reception means capable of transmitting and 
receiving the internal state of the electronic pet, which is 
40 changed in accordance with input information and is 
information for causing the electronic pet to act, and a 
motion section for moving in the real world, and controls 
the motion section to carry out processing for imple- 
menting the electronic pet as an existence in the real 
45 world. 

[0012] With such an electronic pet system, the 
internal state of the electronic pet is changed in accord- 
ance with input information and transmission/reception 
of the internal state is carried out between the informa- 

50 tion processing device and the robot which cause the 
electronic pet to act on the basis of the internal state. 
The information processing device acts on the basis of 
the internal state sent from the robot, and the robot acts 
on the basis of the internal state sent from the informa- 

55 tion processing device. 

[0013] Also, an electronic pet system according to 
the present invention has an information processing 
device and a robot. The information processing device 
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has radio transmission/reception means capable of 
radio-transmitting and receiving the internal state of an 
electronic pet, which is changed in accordance with 
input information and is information for causing the elec- 
tronic pet to act, and image display means, and carries 
out processing for implementing the electronic pet by 
the image display means. The robot has radio transmis- 
sion/reception means capable of radio-transmitting and 
receiving the internal state of the electronic pet, which is 
changed in accordance with input information and is 
information for causing the electronic pet to act, and a 
motion section for moving in the real world, and controls 
the motion section to carry out processing for imple- 
menting the electronic pet as an existence in the real 
world. 

[0014] With such an electronic pet system, the 
internal state of the electronic pet is changed in accord- 
ance with input information and radio transmis- 
sion/reception of the internal state is carried out 
between the information processing device and the 
robot which cause the electronic pet to act on the basis 
of the internal state. The information processing device 
acts on the basis of the internal state sent from the 
robot, and the robot acts on the basis of the internal 
state sent from the information processing device. 
[0015] A network system according to the present 
invention has one or more implementation devices and 
a server device. The implementation device has trans- 
mission/reception means capable of transmitting and 
receiving the internal state of a living body object, which 
is changed in accordance with input information and is 
information for causing the living body object to act, and 
the identification information of the living body object, 
thus implementing the living body object. The server 
device has management means for managing the inter- 
nal state of the living body object and the identification 
information of the living body object, and transmis- 
sion/reception means capable of transmitting/receiving 
at least the internal state and the identification informa- 
tion. The implementation devices and the server device 
are connected with each other via a network. 
[0016] With such a network system, the living body 
object in the implementation device has its internal state 
and identification information managed by the server 
device. 

[0017] Also, a network system according to the 
present invention has an implementation device and an 
information processing device. The implementation 
device has transmission/reception means capable of 
transmitting and receiving the internal state of a living 
body object, which is changed in accordance with input 
information and is information for causing the living 
body object to act, thus implementing the living body 
object. The information processing device has transmis- 
sion/reception means capable of transmitting and 
receiving the internal state of the living body object, 
controls the action of the living body object acting in a 
virtual world on the basis of the internal state of the liv- 



ing body object, and carries out processing for display- 
ing at least the virtual world and the living body object. 
[0018] With such a network system, the interna! 
state of the living body object in the implementation 

5 device, which is changed in accordance with input infor- 
mation and is information for causing occurrence of an 
action, is transferred to the information processing 
device, which carries out processing for displaying at 
least the virtual world and the living body object. 

10 [0019] A robot according to the present invention is 
adapted for storing the internal state of a living body 
object, which is changed in accordance with input infor- 
mation and is information for causing the living body 
object to act, and for controlling a motion section to 

75 carry out processing for implementing the living body 
object as an existence in the real world. The robot trans- 
fers at least the internaf state to an information process- 
ing device, which controls the action of a living body 
object acting in a virtual world on the basis of the inter- 

20 nal state of the living body object in the robot and car- 
ries out processing for displaying at least the virtual 
world and the living body object. 
[0020] Such a robot transfers the internal state, 
which is changed in accordance with input information 

25 and is information for causing occurrence of an action, 
to the information processing device, which carries out 
processing for displaying at least the virtual world and 
the living body object. 

[0021] A storage medium according to the present 
30 invention is adapted for storing data usable in an infor- 
mation processing device and can be inserted 
to/ejected from a slot provided in the information 
processing device. The storage medium has indication 
means for indicating an accurate loading position when 
35 loaded in the slot of the information processing device. 
[0022] Thus, the user loads the storage medium 
into the slot of the information processing device with 
reference to the indication means. 

40 Brief Description of the Drawings 

[0023] 

Fig.1 is a block diagram showing the overall struc- 
45 ture of an embodiment of an electronic pet system 
to which the present invention is applied. 

Fig.2 shows a more specific exemplary structure of 
the electronic pet system. 

50 

Fig. 3 is a block diagram showing an exemplary 
structure of a body section of the electronic pet sys- 
tem. 

55 Fig.4 is a block diagram showing an exemplary 
hardware structure of a virtual electronic pet device. 

Fig.5 is a block diagram showing an exemplary 
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hardware structure of a pet-type robot. card). 



Fig. 6 is a perspective view showing the specific 
structure of the appearance of the pet-type robot. 

5 

Fig. 7 is a block diagram showing the more specific 
circuit structure of the pet-type robot. 

Fig. 8 is a block diagram showing the structure of a 
controller. w 

Fig. 9 is a block diagram showing the structure of an 
emotion/instinct model section. 

Fig. 10 is a block diagram showing a group of emo- w 
tions in the emotion/instinct model section. 

Fig. 1 1 is a block diagram showing the structure of 
an emotion/instinct model section having strength 
increasing/decreasing means. 20 

Fig. 12 is a block diagram showing the structure of 
an action decision mechanism section and the like 
used for explaining generation of action command 
information. 25 

Fig. 13 shows the state transition of a finite probabil- 
ity automaton of an action model. 



Fig.22 is a view for explaining an IC card discrimi- 
nated by color. 

Fig.23 is a view for explaining a stick-shaped IC 
card discriminated by color and having an arrow 
mark appended thereto. 

Fig.24 is a view for explaining a stick-shaped iC 
card discriminated by color and having a line 
appended thereto indicating the boundary position. 

Fig.25 is a view for explaining a stick-shaped IC 
card which is accurately loaded in a slot. 

Fig.26 is a view for explaining an exemplary label 
put on the stick-shaped IC card. 

Figs.27A and 27B show the bottom side and the lat- 
eral side of the stick-shaped IC card. 

Fig.28 shows an example of connection of a sec- 
ond embodiment of the present invention. 

Fig.29 is a block diagram showing the hardware 
structure of an essential portion of a pet-type robot 
of the second embodiment. 



Fig. 14 shows a state transition table. 30 

Fig. 15 shows a graph of posture transition in a pos- 
ture transition mechanism section. 

Fig. 16 shows a specific example of the posture 35 
transition graph. 

Fig. 17 is a perspective view showing the schematic 
structure of a pet-type robot. 

40 

Figs. 1 8A and 1 8B are views for explaining the tran- 
sition of the posture between the entire body and 
respective portions on the basis of a basic posture. 

Fig. 19 is a view for explaining the execution of a tar- 45 
get motion after temporary transition to the basic 
posture in the case where the current posture 
resides in the entire body and the target motion 
resides in a portion. 

50 

Fig. 20 is a view for explaining the execution of a tar- 
get motion after temporary transition to the basic 
posture in the case where the current posture 
resides in a portion and the target motion resides in 
the entire body. 55 

Fig. 21 shows pet characteristic information stored 
in an individual information storage section (IC 



Fig.30 is a front view showing the appearance of a 
virtual electronic pet device of the second embodi- 
ment. 

Fig.31 is a block diagram showing the hardware 
structure of an essential portion of the virtual elec- 
tronic pet device of the second embodiment. 

Fig.32 is a block diagram showing an example of 
connection in which the virtual electronic pet device 
and the pet-type robot are connected with each 
other by a USB cable. 

Fig.33 is a block diagram showing an example of 
connection in which the virtual electronic pet device 
and the pet-type robot are connected with each 
other by infrared rays. 

Fig.34 is a block diagram showing an example of 
connection in which the virtual electronic pet device 
and the pet-type robot are connected with each 
other by radio waves. 

Fig.35 is a block diagram showing an example of 
connection in which the virtual electronic pet device 
and the pet-type robot are connected with each 
other by a Bluetooth module. 

Fig.36 is a block diagram showing an example of 
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connection in which the pet-type robot and a per- 
sonal computer are connected with each other by a 
USB cable and in which the personal computer is 
connected to the Internet. 

5 

Fig. 37 is a block diagram showing an example of 
connection in which the pet-type robot and a per- 
sonal computer are connected with each other by 
infrared rays and in which the personal computer is 
connected to the Internet. 10 

Fig. 38 is a block diagram showing an example of 
connection in which the pet-type robot and a per- 
sonal computer are connected with each other by 
radio waves and in which the personal computer is w 
connected to the Internet 

Fig. 39 is a block diagram showing an example of 
connection in which the pet-type robot and a per- 
sonal computer are connected with each other by a 20 
Bluetooth module and in which the personal com- 
puter is connected to the Internet. 

Fig. 40 shows the flow of transfer of pet characteris- 
tic information from the virtual electronic pet device 25 
to the pet-type robot. 

Fig. 41 shows the flow of transfer of pet characteris- 
tic information from the pet-type robot to the virtual 
electronic pet device. 30 

Fig. 42 shows the flow in the case where transfer of 
pet characteristic information is not carried out 
between the pet-type robot and the virtual elec- 
tronic pet device. 35 

Fig. 43 shows the data format of a connection 
request signal, a connection permission signal, and 
a reception end signal. 

40 

Fig. 44 shows an exemplary system structure of the 
case of managing the electronic pet by a pet shared 
server. 

Fig. 45 is a block diagram showing an exemplary 45 
hardware structure of the pet-type robot and the vir- 
tual electronic pet device in the system structure for 
managing the electronic pet by the shared server. 

Fig.46 is a view for explaining a specific example of 50 
the case of leaving the electronic pet to the shared 
server and the case of receiving the electronic pet 
from the shared server. 

Fig.47 conceptually shows an example in which the 55 
electronic pet and an avatar of the user exist in a 
virtual world. 



Fig. 48 is a block diagram showing an exemplary 
hardware structure of the pet-type robot and the vir- 
tual electronic pet device in the system structure for 
managing the electronic pet by the shared server, 
and showing the state where the pet-type robot and 
the virtual electronic pet device are connected to 
the Internet by a Bluetooth module. 

Fig.49 is a block diagram showing the detailed 
structure of the system in the case where the elec- 
tronic pet and the avatar of the user exist in the vir- 
tual world. 

Fig.50 is a block diagram showing an exemplary 
structure of a client PC used for the system of 
Fig.49. 

Fig.51 is a view for explaining the flow of processing 
from the browsing of a home page of a web site 
which provides VRML contents, to the downloading 
of VRML to the client PC, in the system of Fig.49. 

Fig. 52 is a view for explaining the flow of processing 
from interpretation and execution of a VRML2.0 file 
by the client PC to the inquiry of the URL of the 
shared server, in the system of Fig.49. 

Fig.53 is a view for explaining the flow of processing 
in which a plurality of client PCs receive data 
related to a three-dimensional object via the shared 
server and realize a multi-user environment. 

Best Mode for Carrying Out the Invention 

[0024] Preferred embodiments of the present inven- 
tion will now be described in detail with reference to the 
drawings. 

[0025] Fig. 1 shows the overall structure of an elec- 
tronic pet system as a first embodiment of the present 
invention. (In this specification, the system means a log- 
ical collection of a plurality of devices, regardless of 
whether the respective devices are included in the same 
casing or not.) 

[0026] The electronic pet system has an individual 
information storage section 1 and a body section 2, as 
shown in Fig. 1 . 

[0027] For example, an animal as a living body is 
considered to be made up of the flesh and the soul 
residing in the flesh and controlling the psychological 
function. The individual information storage section 1 of 
the electronic pet system is equivalent to such a soul of 
the animal and is constituted as hardware in the elec- 
tronic pet. The body section 2 is equivalent to such a 
flesh and is constituted as software in the electronic pet. 
[0028] Specifically, the individual information stor- 
age section 1, which expresses the characteristics 
(emotions and physical characteristics) of the electronic 
pet, can be said to function as the soul of the electronic 
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pet. The body section 2, which expresses the actions of 
the electronic pets, can be said to function for imple- 
menting the substantial or virtual flesh of the electronic 
pet and representing the real actions with the substan- 
tial or virtual flesh. The actions of the body section 2 are 
carried out on the basis of the characteristics of the 
electronic pet held by the individual information storage 
section 1. Therefore, the individual information storage 
section 1 can be said to be the core of the electronic pet. 
[0029] The individual information storage section 1 
can be extracted from the body section 2 and can also 
be provided (to reside) in other body sections 2-j, 2 2 , ... 
In this case, the body section 2 in which the individual 
information storage section 1 is not provided does not 
function as an electronic pet. The electronic pet of this 
case is in a so-called cast-off state. 
[0030] On the other hand, the other body sections 
in which the individual information storage section 1 is 
provided starts to function as electronic pets having the 
original characteristics. That is, the soul of the electronic 
pet can switch from one flesh to another. 
[0031] Fig.2 shows a more specific exemplary 
structure of the electronic pet system of Fig. 1 . 
[0032] The individual information storage section 1 
of Fig.1 is expressed by for example, an IC (integrated 
circuit) card 21 . The IC card 21 contains a stamp flash 
memory or the like and stores the quantity of character- 
istics of instincts and emotions of the electronic pet and 
the constitutional information of the body section as will 
be described later (hereinafter referred to as pet charac- 
teristic information). 

[0033] The body section 2 of Fig.1 is realized by, for 
example, a virtual electronic pet device 22 or a pet-type 
robot 23. The virtual electronic pet device 22 is consti- 
tuted by a portable information processing device for 
carrying out processing for displaying a virtual elec- 
tronic pet, and has a slot 22A for loading the IC card 21 
therein. The pet-type robot 23 is a robot having the 
shape of an electronic pet and also has a slot 23A for 
loading the IC card 21 therein. Although a quadrupedal 
robot is used as an example of the pet-type robot in the 
embodiments of the present invention, the form of the 
robot is not particularly limited and various arbitrary 
forms can be employed such as a bipedal robot, a robot 
having wings, a robot having wheels, a robot with no 
limb, and combination or modification of various parts. 
The present invention is applicable to robots of various 
forms. 

[0034] Both the virtual electronic pet device 22 and 
the pet-type robot 23 are devices which function as the 
body section of the electronic pet and do not take any 
action by themselves. Specifically, as the IC card 21 is 
loaded therein, the virtual electronic pet device 22 and 
the pet-type robot 23 function as electronic pets. In the 
case of the virtual electronic pet device 22, an electronic 
pet is displayed on its monitor and the electronic pet dis- 
played on the monitor takes an action based on the pet 
characteristic information stored on the IC card 21 . Sim- 



ilarly, the pet-type robot 23 takes an action based on the 
pet characteristic information stored on the IC card 21 . 
[0035] With such an electronic pet system, the user 
at home can enjoy the feeling close to the feeling of 

5 actually keeping a pet by loading the IC card 21 into the 
slot 23A of the pet-type robot 23. When the user goes 
on a trip, the user can easily carry the electronic pet to 
the destination by detaching the IC card 21 from the pet- 
type robot 23 and loading the IC card 21 into the virtual 

10 electronic pet device 22. 

[0036] Fig.3 shows an exemplary electrical struc- 
ture of the body section 2 of Fig.1. The body section 2 is 
assumed to be the virtual electronic pet device 22 and 
the pet-type robot 23, which will be later described fur- 

w ther in detail. 

[0037] An l/F (interface) 10 is equivalent to the slot 
22A of the virtual electronic pet device 22 or the slot 
23A of the pet-type robot 23 of Fig.1 , and functions as 
an interface for transmission of data between the indi- 

20 vidua! information storage section 1 and the body sec- 
tion 2. Specifically, the l/F 10 reads out information (pet 
characteristic information) expressing the characteris- 
tics of instincts and emotions of the electronic pet and 
the structure of the body section and supplies the infor- 
ms mation to an internal state calculation section 11. The 
l/F 1 0 also writes the information obtained as a result of 
predetermined calculation at the internal state calcula- 
tion section 1 1 to the individual information storage sec- 
tion 1 and updates the storage contents. 

30 [0038] To the internal state calculation section 11, 
inputs from an external input section 12 and atime input 
section 13 are supplied as well as the pet characteristic 
information from the l/F 10 as described above. Moreo- 
ver, specific actions of the electronic pet obtained by an 

35 action conversion section 1 5 are fed back to the internal 
state calculation section 11. The internal state calcula- 
tion section 11 drives emotion and instinct models 
stored in a model storage section 14 in accordance with 
the input from the l/F 10, the external input section 12, 

40 the time input section 1 3, or the action conversion sec- 
tion 15, and updates the internal state of the electronic 
pet. The internal state of the electronic pet relates to the 
information of emotions and instincts included in the pet 
characteristic information from the l/F 10, as will be 

45 described later, and the updated internal state is written 
to the individual information storage section 1 via the l/F 
10. The internal state calculation section 11 also 
decides a motion (conceptual motion) to be made by the 
electronic pet, and outputs a command (motion com- 

so mand) instructing the execution of that motion (concep- 
tual motion) to the action conversion section 15, which 
carries out control to output the real action. 
[0039] The external input section 12 supplies stim- 
uli given by the user or from the external environment to 

55 the internal state calculation section 1 1 . 

[0040] In the case where the body section 2 is the 
virtual electronic pet device 22, the external input sec- 
tion 12 is constituted by a keyboard (or switches and 
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buttons), a microphone, and a voice recognition device. 
The external input section 1 2 changes an operation or a 
speech made by the user for taking care of the elec- 
tronic pet, into an electric signal, and supplies the elec- 
tric signal to the internal state calculation section 1 1 . 
[0041] On the other hand, in the case where the 
body section 2 is the pet-type robot 23, the external 
input section 12 is constituted by a keyboard, a micro- 
phone, a voice recognition device, a photoelectric con- 
version element, an image recognition device, and a 
sensor (e.g., a temperature sensor). The external input 
section 12 changes an operation or a speech made by 
the user for taking care of the electronic pet, into an 
electric signal, and supplies the electric signal to the 
internal state calculation section 1 1 . The external input 
section 12 also supplies information about surrounding 
objects and temperature to the internal state calculation 
section 1 1 . 

[0042] The time input section 1 3 keeps time (includ- 
ing the year, month and day) and supplies the time (cur- 
rent time) to the internal state calculation section 1 1 . 
[0043] The model storage section 1 4 stores models 
of emotions and instincts (emotion/instinct models) of 
the electronic pet. As the emotions of the electronic pet, 
for example, joy, sadness, anger, surprise, fear, and 
hatred are set, and the model storage section 14 stores 
a model of these emotions (e.g., computational formu- 
las for finding parameters expressing these emotions). 
As the instincts of the electronic pet, for example, move- 
ment instinct, love instinct, recharge instinct, and search 
instinct are set, and the mode! storage section 1 4 stores 
a model of these instincts. The internal state of the elec- 
tronic pet is constituted by the state of emotion and the 
state of instinct. 

[0044] The body section 2 has the emotion and 
instinct models of the same structure, irrespective of 
whether it is the virtual electronic pet device 22 or the 
pet-type robot 23. Thus, even when the IC card 21 is 
exchanged between the virtual electronic pet device 22 
and the pet-type robot 23, the characteristics and 
actions of the electronic pet are not changed to those of 
different electronic pets. 

[0045] The action conversion section 15 converts a 
conceptual motion command from the internal state cal- 
culation section 1 1 to a command (action command) 
instructing a specific action (such as an action, motion, 
or posture). The action conversion section 15 supplies 
the command to an output section 1 6 and also supplies 
the command to the internal state calculation section 1 1 
as a feedback. 

[0046] The output section 16 makes an output in 
accordance with the action command from the action 
conversion section 15. Specifically, the output section 
16 causes the electronic pet to take the action in 
accordance with the action command from the action 
conversion section 15. 

[0047] In the case where the body section 2 is the 
virtual electronic pet device 22, the output section 16 is 



constituted by a monitor, a voice synthesizer (e.g., a 
rule-based voice synthesizer), and a speaker. Thus, the 
output of the output section 16 changes the display of 
the electronic pet and outputs a voice. 

5 [0048] On the other hand, in the case where the 
body section 2 is the pet-type robot 23, the output sec- 
tion 1 6 is constituted by motion sections such as motors 
for driving members corresponding to the limbs, trunk, 
head and tail, and a voice synthesizer and a speaker. 

10 Thus, the output of the output section 16 rotates a pre- 
determined motor and outputs a voice. 
[0049] The structure of the virtual electronic pet 
device 22 and the pet-type robot 23 will be described 
using a more specific example. Fig.4 shows an exem- 

75 plary hardware structure of the virtual electronic pet 
device 22. 

[0050] A CPU (central processing unit) 31 is 
adapted for carrying out various types of processing in 
accordance with a program stored in a ROM (read only 
20 memory) 32. A timer circuit 31 A counts a clock, not 
shown, and generates a timer interruption for every pre- 
determined unit time (e.g., 100 ms) to the CPU 31 on 
the basis of the count value. 

[0051] The ROM 32 stores a program to be exe- 
25 cuted by the CPU 31 and data necessary for the execu- 
tion of the program. A RAM (random access memory) 
33 stores data necessary for the operation of the CPU 
31. 

[0052] An l/F 34 functions as an interface between 
30 the CPU 31 on one hand and an A/D converter 36, an 
operation section 37, an IC card connector 38, a D/A 
converter 39 and a liquid crystal controller 41 on the 
other. 

[0053] Of the above-mentioned sections, the CPU 

35 31, the ROM 32, the RAM 33 and the l/F 34 are inter- 
connected via a bus (address bus or data bus). 
[0054] A microphone 35 converts a sound inputted 
thereto (e.g., a whistle sound or the like) to an audio sig- 
nal as an analog electric signal and supplies the audio 

40 signal to the A/D converter 36. The A/D converter 36 
carries out A/D conversion of the analog audio signal 
from the microphone and outputs the resultant digital 
audio signal to the CPU 31 via the l/F 34. 
[0055] In the case where the CPU 31 has thus 

45 received the audio signal, the CPU 31 carries out linear 
prediction analysis of the audio signal so as to extract 
the characteristic quantity, and carries out voice recog- 
nition based on an HMM (hidden Markov model) 
method. A program to be executed by the CPU 31 for 

50 voice recognition and word models as the objects of 
voice recognition are stored, for example, in the ROM 
32. In this case, as the word models to be the objects of 
voice recognition, particularly the words models used by 
the keeper to talk to the pet are stored. The words to be 

55 stored include "Hey", "Good boy", "Good morning", 
"Good night", "Paw", "Sit", "What are you doing?" and 
the like. 

[0056] The method of acoustic analysis is not Mm- 
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ited to the linear prediction analysis, and the method of 
voice recognition is not limited to the HMM method. 
[0057] The operation section 37 is constituted by 
various buttons and keys and supplies a signal corre- 
sponding to the operation from the user to the CPU 31 5 
via the l/F 34. Thus, the CPU 31 can recognize the but- 
tons and keys operated by the user. The operation sec- 
tion 37 has buttons for providing various inputs to the 
electronic pets such as a "scold" button, which is oper- 
ated for scolding the electronic pet, a "praise" button, w 
which is operated for praising the electronic pet, a 
"greeting" button corresponding to saying "Good morn- 
ing" or "Good night", and a "paw" button and a "sit" but- 
ton, which are operated for instructing the electronic pet 
to raise the paw or to sit as a performance. w 
[0058] The IC card connector 38 is provided in the 
slot 22A of the virtual electronic pet device 22 (Fig. 2), 
and is adapted for electrically connecting the IC card 21 
with the CPU 31 via the l/F 34 when the IC card 21 is 
loaded in the slot 22A. In this case, the CPU 31 reads 20 
data from and writes data to the IC card 21 via the l/F 34 
and the IC card connector 38. The CPU 31 can also 
detect the loading of the IC card 21 . 
[0059] The D/A converter 39 carries out D/A con- 
version of the digital audio signal supplied from the CPU 25 
31 via the i/F 34 and supplies the resultant analog audio 
signal to a speaker 40. The speaker 40 contains an 
amplifier to amplify the audio signal from the D/A con- 
verter 39 and to output the amplified audio signal. The 
CPU 31 generates a voice of the electronic pet or other 30 
necessary sounds by voice synthesis, if necessary, and 
outputs the synthesized sound to the D/A converter 39 
via the l/F 34. A program for carrying out voice synthesis 
and data necessary for voice synthesis are stored, for 
example, in the ROM 32. 35 
[0060] The liquid crystal controller 41 is controlled 
by the CPU 31 via the l/F 34 and displays various 
images (e.g., an image of the electronic pet) and char- 
acters on a liquid crystal display section 42. The liquid 
crystal display section 42 displays images and charac- 40 
ters under the control of the liquid crystal controller 41. 
The ROM 32 stores a program for displaying images 
and characters on the liquid crystal display section 42 
by controlling the liquid crystal controller 41, and the 
CPU 31 executes this program, thus displaying images 45 
and characters on the liquid crystal display section 42. 
[0061] The foregoing is the exemplary hardware 
structure of the virtual electronic pet device 22. An 
exemplary hardware structure of the pet-type robot 23 
will now be described. The exemplary hardware struc- so 
ture of the pet-type robot 23 is as shown in Fig. 5. 
[0062] In Fig.5, the portions corresponding to those 
of the virtual electronic pet device 22 of Fig.4 are 
denoted by the same numerals. Specifically, the pet- 
type robot 23 has basically the same structure as the 55 
virtual electronic pet device 22, except for a motor 51 
and a driving mechanism 52 provided in place of the liq- 
uid crystal controller 41 and the liquid crystal display 



section 42. 

[0063] The motor 51 is controlled by the CPU 31 via 
the l/F 34 and is adapted for driving the driving mecha- 
nism 52. The driving mechanism 52 constitutes, for 
example, the head, limbs, trunk or tail as moving parts 
of the pet-type robot 23 and is driven by the motor 51 . 
[0064] The l/F 34 and the IC card connector 38 of 
Figs. 4 and 5 correspond to the l/F 10 of Fig.3, and the 
CPU 31 and the ROM 32 of Figs.4 and 5 correspond to 
the internal state calculation section 1 1 and the action 
conversion section 15 of Fig.3. The microphone 35, the 
A/D converter 36 and the operation section 37 of Figs.4 
and 5 correspond to the external input section 12 of 
Fig.3. The timer circuit 31 A of Figs.4 and 5 corresponds 
to the time input section 1 3 of Fig.3, and the ROM 32 of 
Figs.4 and 5 corresponds to the model storage section 
14 of Fig.3. Moreover, the D/A converter 39 and the 
speaker 40 of Figs.4 and 5, the liquid crystal controller 
41 and the liquid crystal display section 42 of Fig.4, or 
the motorSI and the driving mechanism 52 of Fig.5 cor- 
respond to the output section 16 of Fig.3. 
[0065] The pet-type robot 23 will be described fur- 
ther in detail. The overall shape (appearance) of the pet- 
type robot 23 is constituted by coupling a head portion 
61 corresponding to the bead, a trunk portion 62 corre- 
sponding to the trunk, limb portions 63A, 63B, 63C and 
63D corresponding to the four limbs, and a tail portion 
64 corresponding to the tail, as shown in Fig. 6. The pet- 
type robot 23 of such a structure moves the head por- 
tion 61 , the limb portions 63A to 63D, and the tail portion 
64 with respect to the trunk portion 62, thus moving like 
a real quadrupedal animal. The pet-type robot 23 has 
the slot for loading the IC card 21 , though not shown. 
[0066] On the head portion 61, an image recogni- 
tion section 71 made up of a CCD (charge coupled 
device) camera corresponding to the eyes for picking up 
an image, a microphone 72 corresponding to the ears 
for picking up a sound, and a speaker 73 corresponding 
to the mouth for generating a sound are attached at pre- 
determined positions, as shown in Fig.7. Also, on the 
head portion 61, a remote controller receiving section 
74 for receiving a command transmitted from the user 
via a remote controller (not shown), a touch sensor 75 
for detecting the tough by the user's hand or the like, 
and a LED (light-emitting diode) 76 made up of light- 
emitting means are attached. 

[0067] On the trunk portion 62, a battery 77 is 
attached at a position corresponding to the abdomen, 
and an electronic circuit (not shown) for controlling the 
operation of the entire pet-type robot 23 is housed 
inside the trunk portion 62. 

[0068] Joint portions of the limb portions 63A to 
63D, coupling portions between the limb portions 63A to 
63D and the trunk portion 62, a coupling portion 
between the trunk portion 62 and the head portion 61, 
and a coupling portion between the trunk portion 62 and 
the tail portion 64 are coupled by their respective actua- 
tors 78Ato 78N and are driven under the control of the 
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electronic circuit housed inside the trunk portion 62. By 
thus driving the actuators 78A to 78N, the pet-type robot 
23 moves like a real quadrupedal animal, for example, 
shakes the head portion 61 vertically and horizontally, 
wags the tail portion 64, and moves the limb portions 5 
63A to 63Dto walk or run. 

[0069] Such a pet-type robot 23 changes the inter- 
nal state such as emotions and instincts on the basis of 
input information like circumferential information and 
internal information (e.g., information of the remaining 
capacity of the battery). The internal state is stored on 
the IC card 21. 

[0070] The pet-type robot 23 controls the motion 
sections such as the head portion 61 , the trunk portion 
62, the limb portions 63A to 63D and the tail portion 64 
(which are moved by the actuators 78A to 78N) on the 
basis of the changed internal stale, and thus realizes 
the electronic pet in the real world. The circuit structure 
of such a pet-type robot 23 will now be described in 
detail with reference to Fig. 7. 

[0071] The head portion 61 has a command receiv- 
ing section 80 made up of the microphone 72 and the 
remote controller receiving section 74, an external sen- 
sor 81 made up of the image recognition section 71 and 
the tough sensor 75, the speaker 73, and the LED 76. 
The trunk section 62 has the battery 77, and also has 
therein a controller 82 for controlling the operation of the 
entire pet-type robot 23, and an internal sensor 85 
made up of a battery sensor 83 for detecting the remain- 
ing capacity of the battery 77 and a heat sensor 84 for 
detecting the heat generated within the pet-type robot 
23. Moreover, the actuators 78Ato 78N are provided at 
predetermined positions in the pet-type robot 23. 
[0072] The command receiving section 80 is 
adapted for receiving commands given to the pet-type 
robot 23 from the user such as "Walk", "Down", and 
"Chase the ball", and is constituted by the microphone 
72 and the remote controller receiving section 74. 
[0073] The remote controller receiving section 74 
receives a desired command inputted by the user oper- 
ating the remote controller (not shown). For example, 
the transmission of a command from the remote control- 
ler is carried out using an infrared ray. The remote con- 
troller receiving section 74 receives this infrared ray to 
generate a received signal S1 A and sends it to the con- 
troller 82. 

[0074] The remote controller is not limited to the 
one using infrared rays but may also be adapted for giv- 
ing a command to the pet-type robot 23 by using the 
musical scale. In such a case, the pet-type robot 23 car- 
ries out processing corresponding to the musical scale 
from the remote controller inputted from the microphone 
72. 

[0075] When the user generates a voice in accord- 
ance with a desired command, the microphone 72 picks 
up the voice generated by the user to generate an audio 
signal S1 B and sends it to the controller 82. 
[0076] The command receiving section 80 thus 



generates a command signal SI made up of the 
received signal S1 A and the audio signal S1 B in accord- 
ance with the command given to the pet-type robot 23 
from the user, and supplies the command signal S1 to 
the controller 82. 

[0077] The touch sensor 75 of the external sensor 
81 is adapted for detecting the approach from the user 
to the pet-type robot 23, for example, "pat", "slap" and 
the like. For example, when the user touches the touch 
sensor 75 and takes a desired manner of approach, the 
touch sensor 75 generates a touch detection signal S2A 
corresponding to that approach and sends it to the con- 
troller 82. 

[0078] The image recognition section 71 of the 
external sensor 81 is adapted for detecting the environ- 
ment information around the pet-type robot 23 such as 
"dark" or "there is my favorite toy", or the motion of other 
robot devices such as "another robot is running", as a 
result of identifying the environment around the pet-type 
robot 23. This image recognition section 71 sends an 
image signal S2B obtained as a result of picking up the 
image of the surroundings, to the controller 82. 
[0079] The external sensor 81 thus generates an 
external information signal S2 made up of the touch 
detection signal S2A and the image signal S2B in 
accordance with the external information provided from 
outside the pet-type robot 23, and sends the external 
information signal S2 to the controller 82. 
[0080] The internal sensor 85 is adapted for detect- 
ing the internal information of the pet-type robot 23 
itself, for example, "I'm hungry", which means the bat- 
tery capacity is lowered, "I have a fever" and the like. 
The internal sensor 85 is constituted by the battery sen- 
sor 83 and the heat sensor 84. 
[0081] The battery sensor 83 is adapted for detect- 
ing the remaining capacity of the battery 77, which sup- 
plies the power to each circuit of the pet-type robot 23. 
This battery sensor 83 sends a battery capacity detec- 
tion signal S3A as a result of detection to the controller 
82. 

[0082] The heat sensor 84 is adapted for detecting 
the heat within the pet-type robot 23. This heat sensor 
84 sends a heat detection signal S3B as a result of 
detection to the controller 82. 

[0083] The internal sensor 85 thus generates an 
internal information signal S3 made up of the battery 
capacity detection signal S3A and the heat detection 
signal S3B in accordance with the internal information 
of the pet-type robot 23, and sends it to the controller 
82. 

[0084] The image recognition 71, the microphone 
72, the remote controller receiving section 74, the touch 
sensor 75 and the like shown in Fig. 7 correspond to the 
external input section 12 shown in Fig. 3. The actuators 
78A to 78N shown in Fig.7 correspond to the output 
section 16 shown in Fig. 3. As a matter of course, the 
constituent parts that are not shown in Fig.7 but shown 
in Fig.3 or Fig.5 may also be provided as the constituent 
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parts of the pet-type robot 23 of Fig. 7. For example, the 
constituent part such as the time input section 13 may 
be provided. 

[0085] The controller 82 generates control signals 
S5A to S5N for driving the actuators 78A to 78N on the 
basis of the input information, that is, the command sig- 
nal S1 supplied from the command receiving section 80, 
the external information signal S2 supplied from the 
external sensor 81 and the internal information signal 
S3 supplied from the internal sensor 85, and sends 
these control signals to drive the actuators 78A to 78N, 
thus operating the pet-type robot 23. 
[0086] The controller 82 generates an audio signal 
S1 0 or a light-emitting signal 11 to be outputted to the 
outside, if necessary, and outputs the audio signal S10 
to the outside via the speaker 73 or sends the light-emit- 
ting signal S1 1 to the LED 76 to carry out desired light- 
emitting output (e.g., flashing or changing the color), 
thus notifying the user of the necessary information. For 
example, by the light-emitting output, the controller 82 
notifies the user of the emotion of the electronic pet. An 
image display section for displaying an image can be 
provided in place of the LED 76. Thus, it is possible to 
notify the user of the necessary information like the 
emotion by displaying a desired image. The processing 
at the controller 82 will now be described in detail. 
[0087] The controller 82 carries out software-like 
data processing on the command signal S1 supplied 
from the command receiving section 80, the external 
information signal S2 supplied from the external sensor 
81 and the internal information signal S3 supplied from 
the internal sensor 85 on the basis of a program stored 
in advance in a predetermined storage area, and sup- 
plies control signals S5 obtained as a result to the actu- 
ators 78 A to 78N. The actuators 78 A to 78 N operate on 
the basis of the control signals S5A, S5B, S5N. 
[0088] As shown in Fig. 8, the contents of the data 
processing at the controller 82 are functionally classified 
into an emotion/instinct model section 90 as emo- 
tion/instinct model change means, an action decision 
mechanism section 91 as motion decision means, a 
posture transition mechanism section 92 as posture 
transition means, and a control mechanism section 93. 
The command signal S1 , the external information signal 
S2 and the internal information signal S3 supplied from 
outside are inputted to the emotion/instinct model sec- 
tion 90 and the action decision mechanism section 91. 
These sections roughly function as follows. 
[0089] The emotion/instinct model section 90 
decides the state of emotions and instincts on the basis 
of the command signal S1 , the external information sig- 
nal S2 and the internal information signal S3. The action 
decision mechanism section 91 decides the next motion 
(action) on the basis of the emotion/instinct state infor- 
mation S1 0 obtained by the emotion/instinct model sec- 
tion 90 in addition to the command signal S1, the 
external information signal S2 and the internal informa- 
tion signal S3, and the posture transition mechanism 



section 92 on the subsequent stage makes a posture 
transition plan for shifting to the next motion (action) 
decided by the action decision mechanism section 91. 
The information of the motion (action) decided by the 

5 action decision mechanism section 91 is fed back to the 
emotion/instinct model section 90, and the emo- 
tion/instinct model section 90 decides the state of emo- 
tions and instincts with reference to the decided motion 
(action). That is, the emotion/instinct model section 90 

jo decides the instinct and emotion afso with reference to 
the motion (action) result. 

[0090] The control mechanism section 93 controls 
each motion section in accordance with the posture 
transition information S18 sent on the basis of the pos- 

15 ture transition pfan from the posture transition mecha- 
nism section 92, then actually shifts the posture, and 
then actually carries out the next motion (action) 
decided by the action decision mechanism section 91 . 
[0091] That is, using the above-described controller 

20 82, the pet-type robot 23 decides the next motion 
(action) on the basis of the emotions and instincts, then 
makes the transition plan for realizing the posture to 
enable execution of such a motion (action), then shifts 
the posture on the basis of the transition plan, and actu- 

25 ally executes the motion (action) decided on the basis of 
such emotions and instincts. 

[0092] The function of the model storage section 1 4 
for emotions and instincts and the internal state calcula- 
tion section 11 shown in Fig.3 is realized by the emo- 

30 tion/instinct model section 90 shown in Fig. 8, and the 
function of the action conversion section 15 shown in 
Fig.3 is realized by the action decision mechanism sec- 
tion 91, the posture transition mechanism section 92 
and the control mechanism section 93 shown in Fig. 8. 

35 The constituent parts of the above-described controller 
82 will now be described. 

[0093] The emotion/instinct model section 90 gen- 
erally has a group of emotions 1 00 constituting the emo- 
tion model, and a group of instincts 1 01 constituting the 
40 instinct model prepared as a model with different 
attributes from those of the emotion model, as shown in 
Fig.9. 

[0094] In this case, the emotion model is a model 
which is constituted by emotion parameters having cer- 

45 tain values and adapted for expressing the emotion pre- 
scribed for the robot device by means of a motion 
corresponding to the values of the emotion parameters. 
[0095] The emotion parameters have their values 
increased or decreased mainly in accordance with an 

50 external input signal (circumferential information or 
external element) indicating "being slapped" or "being 
scolded" detected by a sensor like a pressure sensor or 
a visual sensor. Of course, in some cases, the emotion 
parameters may be changed in accordance with an 

55 internal input signal (internal information or internal ele- 
ment) such as the remaining capacity of the battery or 
the temperature within the body. Also, the emotion 
parameters are changed simply with the lapse of time. 
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[0096] The instinct model is a model which is con- 
stituted by instinct parameters having certain values 
and adapted for expressing the instinct (desire) pre- 
scribed for the robot device by means of a motion corre- 
sponding to the values of the instinct parameters. The 5 
instinct parameters have their values increased or 
decreased mainly in accordance with an internal input 
signal indicating "I want to move" based on the action 
record or "I need recharge (I'm hungry)" based on the 
remaining capacity of the battery. Of course, similar to 70 
the emotion parameters, the instinct parameters may be 
changed in accordance with an external input signal. 
Also, the instinct parameters are changed simply with 
the lapse of time. 

[0097] The emotion model and the instinct model 75 
are constituted by a plurality of types of models having 
the same attributes, respectively. Specifically, the group 
of emotions 100 has emotion units 100A to 100F as 
independent emotion models having the same attribute, 
and the group of instincts 1 01 has instinct units 1 01 A to 20 
101D as independent instinct models having the same 
attribute. 

[0098] The group of emotions 100 has the emotion 
unit 100A expressing the emotion of "joy", the emotion 
unit 100B expressing the emotion of "sadness", the 25 
emotion unit 100C expressing the emotion of "anger", 
the emotion unit 100E expressing the emotion of "sur- 
prise", and the emotion unit 100F expressing the emo- 
tion of "hatred". 

[0099] The group of instincts 101 has the instinct 30 
unit 101 A expressing the "movement instinct", the 
instinct unit 1 01 B expressing the "love instinct", the 
instinct unit 101 C expressing the "recharge instinct", 
and the instinct unit 1 01 D expressing the "search 
instinct". 35 
[0100] With respect to the emotion units 100A to 
100F, the degree of the emotion is expressed by the 
strength (emotion parameter) of, for example, 0 to 100, 
and the strength of the emotion is changed every 
moment on the basis of the supplied command signal 40 
S1, externa! information signal S2 and internal informa- 
tion signal S3. Thus, the emotion/instinct model 90 
expresses the state of the emotion of the pet-type robot 
23 by combining the strengths of the emotion units 
100A to 100F which are changed every moment, and 45 
thus forms a model of emotional changes along the 
time. 

[0101] Moreover, desired emotion units affect each 
other to change the strength. For example, the emotion 
units are coupled in a mutually suppressive manner or 50 
in a mutually stimulative manner so as to affect each 
other, thus changing the strength. 
[0102] Specifically, as shown in Fig. 10, if the emo- 
tion unit 100A of "joy" and the emotion unit 100B of 
"sadness" are coupled in a mutually suppressive man- 55 
ner, when the pet-type robot is praised by the user, the 
strength of the emotion unit 100A of "joy" is increased, 
and the strength of the emotion unit 100B of "sadness" 
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is reduced in accordance with the increase in the 
strength of the emotion unit 100A of "joy" even though 
the input information S1 to S3 for changing the strength 
of the emotion unit 100B of "sadness" is not supplied. 
Similarly, when the strength of the emotion unit 1 00B of 
"sadness" is increased, the strength of the emotion unit 
1 00A of "joy" is reduced in accordance with the increase 
in the strength of the emotion unit 1 00B of "sadness". 
[0103] If the emotion unit 100B of "sadness" and 
the emotion unit 1 00C of "anger" are coupled in a mutu- 
ally stimulative manner, when the pet-type robot is 
slapped by the user, the strength of the emotion unit 
100C of "anger" is increased, and the strength of the 
emotion unit 100B of "sadness" is increased in accord- 
ance with the increase in the strength of the emotion 
unit 100C of "anger" even though the input information 
S1 to S3 for changing the strength of the emotion unit 
100B of "sadness" is not supplied. Similarly, when the 
strength of the emotion unit 100B of "sadness" is 
increased, the strength of the emotion unit 100C of 
"anger" is increased in accordance with the increase in 
the strength of the emotion unit 1 00B of "sadness". 
[0104] As the desired emotion units thus affect 
each other to change the strength, a change of the 
strength of one of the coupled emotion units leads to a 
change of the strength of the other emotion unit, thus 
realizing the pet-type robot 23 having natural emotions. 
[0105] With respect to the emotion units 101 A to 
101D, similar to the emotion units 100A to 100F, the 
degree of the instinct is expressed by the strength 
(instinct parameter) of, for example, 0 to 100, and the 
strength of the instinct is changed every moment on the 
basis of the supplied command signal S1 , external infor- 
mation signal S2 and internal information signal S3. 
Thus, the emotion/instinct model 90 expresses the state 
of the instinct of the pet-type robot 23 by combining the 
strengths of the instinct units 101 A to 1 01 D which are 
changed every moment, and thus forms a model of 
instinct changes along the time. 
[0106] Moreover, similar to the case of coupling the 
emotion units, desired instinct units affect each other to 
change the strength. For example, the instinct units are 
coupled in a mutually suppressive manner or in a mutu- 
ally stimulative manner so as to affect each other, thus 
changing the strength. Thus, when the strength of one 
of the coupled instinct units is changed, the strength of 
the other instinct unit is changed accordingly, and the 
pet-type robot 23 having natural instincts is realized. 
[0107] Furthermore, the units of the group of emo- 
tions 100 and the group of instincts 101 affect each 
other to change the strength. For example, changes of 
the strength of the instinct unit 1 01 B expressing "love 
instinct" and the instinct unit 1 01 C expressing "recharge 
instinct" of the group of instincts 101 affect changes of 
the strength of the emotion unit 100B expressing "sad- 
ness" and the emotion unit 100C expressing "anger" of 
the group of emotions 100. Thus, if the "love instinct" is 
satisfied, the emotion of "anger" and the emotion of 
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"sadness" are suppressed, and if the "recharge instinct" 
is not satisfied, the emotion of "anger" and the emotion 
of "sadness" are increased. With such interaction 
between emotions and instincts, it is possible to express 
the state where emotions and instincts affect one 
another complicatedly. 

[0108] As is described above, the emotion/instinct 
model section 90 changes the strength of the emotion 
units 100Ato 100F and the instinct units 101 A to 101D, 
using the input information S1 to S3 consisting of the 
command signal S1, the external information signal S2 
and the internal information signal S3, or the interaction 
between the emotion units of the group of emotions 
100, the interaction between the instinct units of the 
group of instincts 101, and the interaction between the 
units of the group of emotions 100 and the group of 
instincts 101. 

[0109] The emotion/instinct model section 90 
decides the state of the emotion by combining the 
changed strengths of the emotion units 100A to 100F, 
and decides the state of the instinct by combining the 
changed strengths of the instinct units 1 01 A to 1 01 D. 
The emotion/instinct model section 90 then sends the 
decided state of the emotion and the decided state of 
the instinct as emotion/instinct state information S10 to 
the action decision mechanism section 91. 
[0110] The emotion/instinct model section 90 is 
supplied with action information S12 indicating the con- 
tents of the current or past action of the pet-type robot 
23 itself from the action decision mechanism section 91 
on the subsequent stage. For example, in the case 
where an action of walking is decided by the action deci- 
sion mechanism section 91, which will be described 
later, the action information S12 indicating that the pet- 
type robot "has walked for a long time" is supplied. 
[0111] By thus feeding back the action information 
S12, different emotion/instinct state information S10 
can be generated in accordance with the action of the 
pet-type robot 23 indicated by the action information 
S12, even though the same input information S1 to S3 
is provided. Specifically, with the following structure, the 
action information S12 that is fed back is referred to in 
deciding the state of the emotion and the state of the 
instinct. 

[0112] As shown in Fig.11, in the emotion/instinct 
model section 90, strength increase/decrease means 
1 02A to 1 02C for generating strength information S1 4A 
to S14C for increasing/decreasing the strengths of the 
emotion units 100A to 100C on the basis of the action 
information S12 indicating the action of the pet-type 
robot 23 and the input information S1 to S3 are provided 
on the stage prior to the emotion units 100A to 100C, 
and the strengths of the emotion units 100A to 100C are 
increased/decreased in accordance with the strength 
information S14A to SMC outputted from the strength 
increase/decrease means 102Ato 102C. 
[0113] For example, when the pet-type robot greets 
the user and is patted on the head by the user, that is, 



when the action information S12 indicating that the pet- 
type robot has greeted and the input information S1 to 
S3 indicating that the pet -type robot is patted on the 
head are supplied to the strength increase/decrease 

5 means 102A, the emotion/instinct model section 90 
increases the strength of the emotion unit 1 00A of "joy". 
On the other hand, when the pet-type robot which is car- 
rying out a certain task is patted on the head, that is, 
when the action information S12 indicating that the pet- 

w type robot is carrying out a task and the input informa- 
tion S1 to S3 indicating that the pet-type robot is patted 
on the head are supplied to the strength 
increase/decrease means 102A, the emotion/instinct 
model section 90 does not change the strength of the 

7 5 emotion unit 1 00A of "joy". The strength 
increase/decrease means 102A is constituted, for 
example, as a function or a table for generating the 
strength information S14A to S14C on the basis of the 
action information S12 and the input information S1 to 

20 S3. The other strength increase/decrease means 102B 
and 102C are similarly constituted. 
[0114] Thus, since the emotion/instinct model sec- 
tion 90 has the strength increase/decrease means 1 02A 
to 102C and decides the strengths of the emotion units 

25 1 00A to 1 00C with reference to not only the input infor- 
mation S1 to S3 but also the action information S1 2 indi- 
cating the current or past action of the pet-type robot 23, 
it is possible to avoid occurrence of an unnatural emo- 
tion such that the strength of the emotion unit 100A of 

30 "joy" is increased when the user pats the pet-type robot 
on the head with a mischievous intention while the pet- 
type robot is carrying out a certain task. Similarly, the 
emotion/instinct model section 90 also increases or 
decreases the strengths of the instinct units 101 A to 

35 1 01 C on the basis of the input information S1 to S3 and 
the action information S12 supplied thereto. 
[0115] In the present embodiment, the strength 
increase/decrease means 102A to 102C are provided 
for the emotion units 100A to 100C of "joy", "sadness" 

40 and "anger". However, it is a matter of course that the 
present invention is not limited to such a structure and 
that strength increase/decrease means can also be pro- 
vided for the other emotion units 100D to 100F of "sur- 
prise", "fear" and "hatred". 

45 [0116] As is described above, when the input infor- 
mation S1 to S3 and the action information S12 are 
inputted, the strength increase/decrease means 102A 
to 102C generate and output the strength information 
S14A to S14C in accordance with a predetermined 

so parameter. Therefore, by varying the value the parame- 
ter for each pet-type robot 23, the individuality such as 
being quick-tempered or cheerful can be provided for 
the robot. 

[0117] The processing at the action decision mech- 
55 anism section 91 will now be described. Specifically, the 
action decision mechanism section 91 decides the next 
motion (action) on the basis of various types of informa- 
tion in cooperation with a selection module 94 shown in 



12 



23 



EP 1 092 458 A1 



24 



Fig. 12. The action decision mechanism section 91 is 
supplied with information S14 consisting of the com- 
mand signal S1, the external information signal S2, the 
internal information signal S3, the emotion/instinct state 
information S10 and the action information S12, as 
shown in Fig. 8, and decides the next motion (action) on 
the basis of this information S14. 
[0118] The action decision mechanism section 91 
holds a plurality of action models such as "the first 
action model (action model 1)", "the second action 
model (action model 2)", "the third action model (action 
model 3)", "the fourth action model (action model 4)", 
"the n-th action model (action model n, where n is an 
integer)", as shown in Fig. 12. For example, the action 
models are models for deciding the action in each 
scene such as "the case where the remaining capacity 
of the battery is reduced", "the case of recovering from 
falling", "the case of avoiding an obstacle", and "the 
case where a ball is detected". That is, when certain 
information is inputted, an action model (or a plurality of 
action models) specified for the input information reacts 
to it and the action model that has thus reacted decides 
the next action. 

[0119] Then, the results of decision by the first to n- 
th action models on the basis of the information S14 are 
outputted to selection module 94. 
[0120] As a technique for deciding the next action, 
the first to n-th action models use an algorithm which is 
called a finite probability automaton for deciding the 
transition that should be made from one node (state) 
NODEO to NODEn to another node NODEO to NODEn 
as shown in Fig.1 3 in terms of the probability on the 
basis of the transition probabilities P1 to Pn set for arcs 
ARC1 to ARCn connecting the respective nodes 
NODEO to NODEn. 

[0121] Specifically, the first to n-th action models 
have a state transition table 95 as shown in Fig. 14 for 
each of the nodes NODEO to NODEn, corresponding to 
the node NODEO to NODEn constituting the action 
models themselves. 

[0122] In the state transition table 95, input events 
(recognition result) as the transition conditions in the 
nodes NODEO to NODEn are listed in a preferential 
order in the row of "name of input event", and further 
conditions with respect to the transition conditions are 
described in the columns corresponding to the rows of 
"name of data" and "range of data". 
[0123] In the node NODE100 shown in the state 
transition table 95 of Fig. 14, the conditions for transition 
to another node include that when the recognition result 
(information S14) to the effect that "a ball is detected 
(BALL)" is provided, the "size (SIZE)" of the ball pro- 
vided together with the recognition result or as the rec- 
ognition result is within the range of "0 to 1 000", or that 
when the recognition result to the effect that "an obsta- 
cle is detected (OBSTACLE)" is provided, the "distance 
(DISTANCE)" to the obstacle provided together with the 
recognition result is within the range of "0 to 100". 



[0124] In this node NODE100, the node as the des- 
tination of transition is selected also with reference to 
whether the strength of a desired unit exceeds a prede- 
termined threshold value or not, of the strengths of the 

5 emotion units 100Ato 100F and the instinct units 101 A 
to 1 01 D indicated by the emotion/instinct state informa- 
tion S10 supplied as the recognition result (information 
S14) from the emotion/instinct model section 90. Thus, 
even when the same command signal S1 is inputted, 

70 transition to different nodes is made depending on the 
strengths of the emotion units 100A to 100F and the 
instinct units 101 A to 101 D. 

[0125] In this node NODE100, even in the case 
where there is no input of the recognition result (infor- 

75 mation S14), transition to another node can be made 
when the parameter value of any of "joy (JOY)", "sur- 
prise (SURPRISE)" and "sadness (SADNESS)" held by 
the emotion models is within the range of "50 to 1 00", of 
the parameter values of the emotions and instincts held 

20 by the emotion/instinct model section 90. 

[0126] In the state transition table 95, the names of 
nodes to which transition from the node NODEO to 
NODEn can be made are listed in the column of "transi- 
tion destination node" in the section of "probability of 

25 transition to another node", and the probabilities of tran- 
sition to another node NODEO to NODEn that can be 
made when all the conditions described in the rows of 
"name of input event", "name of data" and "range of 
data" are met are described in the corresponding 

30 spaces within the section of "probability of transition to 
another node". Also, the actions to be outputted in tran- 
sition to the nodes NODEO to NODEn are described in 
the row of "output action" in the section of "probability of 
transition to another node". The sum of the probabilities 

35 described in the respective rows in the section of "prob- 
ability of transition to another node" is 100 [%]. The 
probability of transition may be changed. For example, 
the probability of transition is changed by the learning 
function. Thus, the pet-type robot 23 changes the prob- 

40 ability of transition in accordance with the result of 
learning and therefore obtains individuality with respect 
to the decision of the action. For example, the probabil- 
ity of transition, which is the characteristic of the pet- 
type robot 23, is stored as the pet characteristic infor- 

45 mation into the individual information storage section 1 
(ICcard 21). 

[0127] In the node NODE100 shown in the state 
transition table 95 of Fig. 14, for example, when the rec- 
ognition result (information S14) to the effect that "the 

so ball is detected (BALL)" and that the "size (SIZE)" of the 
ball is within the range of "0 to 100" is provided, transi- 
tion to "node NODE120 (node 120)" can be made with 
the probability of "30%", and then the action of 
"ACTION1" is outputted. 

55 [0128] With such action models, for example, when 
it is detected on the basis of the supplied external infor- 
mation S2 that the palm is presented in front of the pet- 
type robot, and it is detected on the basis of the emo- 
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tion/instinct state information S10 that the strength of 
the motion unit 1 0OC of "anger" is not higher than a pre- 
determined threshold value, and it is detected on the 
basis of the internal information signal S3 that "the pet- 
type robot is not hungry", that is, the voltage of the bat- 
tery is not lower than a predetermined threshold value, 
the action for making the motion of "giving the paw" is 
decided in response to the presentation of the palm in 
front of the pet-type robot. 

[0129] On the other hand, when it is detected that 
the palm is presented in front of the pet-type robot, and 
that the strength of the emotion unit 100C of "anger" is 
not higher than the predetermined threshold value, and 
that "the pet-type robot is hungry", that is, the voltage of 
the battery is less than the predetermined threshold 
value, the action for making the motion of "licking the 
palm" is decided. 

[0130] Alternatively, when it is detected that the 
palm is presented in front of the pet-type robot, and that 
the strength of the emotion unit 100C of "anger" is equal 
to or higher than the predetermined threshold value, the 
action of making the motion of "turning away" is decided 
irrespective of whether "the pet-type robot is not hun- 
gry", that is, whether the voltage of the battery is not 
lower than the predetermined threshold value. 
[0131] The first to n-th action models are consti- 
tuted in such a manner that a number of nodes NODEO 
to NODEn described as the state transition table 95 are 
connected. Thus, when the recognition result (informa- 
tion S14) is provided, the next action is decided in terms 
of the probability by using the state transition table of the 
corresponding node NODEO to NODEn, and the result 
of decision is outputted to the selection module 94. 
[0132] The selection module 94 selects the action 
outputted from the action model of the predetermined 
high priority, of the actions outputted from the first to n- 
th action models, and outputs the information of the 
selected action as action command information S16 to 
the posture transition mechanism section 92. For exam- 
ple, the action models described on the lower side in 
Fig. 12 are of higher priority. 

[0133] The selection module 94 also outputs the 
result of selection as the action information S12 to the 
emotion/instinct model section 90 and the action deci- 
sion mechanism section 91. For example, the selection 
module 94 raises a flag on the decided action and out- 
puts its information as the action information S12 and 
the action command information S1 6 to the action deci- 
sion mechanism section 91 and the posture transition 
mechanism section 92. 

[0134] The action decision mechanism section 91 
decides the action on the basis of the action information 
S12 as well as the external information (the command 
signal S1 and the external information signal S2) S21 
and the internal information (the internal information 
signal S3 and the emotion/instinct state information 
S10) S22, and thus can decide the next action in con- 
sideration of the previous action. 



[0135] The emotion/instinct model section 90 
changes the state of the emotion and the state of the 
instinct on the basis of the action information S12 as 
well as the same information S1 to S3 (consisting of the 

5 command signal S1, the external information S2 and 
the internal information signal S3) as described above. 
Thus, the emotion/instinct model section 90 can gener- 
ate different emotion/instinct state information S1 0 even 
when the same information S1 to S3 is provided, as 

jo described above. 

[0136] Since the contents of the information S1 to 
S3 vary in accordance with the timing of being inputted 
to the emotion/instinct model section 90 and the action 
decision mechanism section 91, the information S1 to 

is S3 is inputted to both the emotion/instinct model section 
90 and the action decision mechanism section 91 . 
[0137] For example, when the external information 
signal S2 to the effect that "the pet-type robot is patted 
on the head" is supplied, the controller 82 causes the 

20 emotion/instinct model section 90 to generate the emo- 
tion/instinct state information S1 0 indicating "joy" and to 
supply this emotion/instinct state information S1 0 to the 
action decision mechanism section 91. fn this state, if 
the external information signal S2 indicating that "the 

25 palm is in front of the pet-type robot" is supplied, the 
action decision mechanism 91 decides the action of 
"giving the paw with joy" on the basis of the emo- 
tion/instinct state information S10 indicating "joy" and 
the external information signal S2 to the effect that "the 

30 palm is in front of the pet-type robot". 

[0138] By the above-described various types of 
means, the action command information S16 is decided 
by the action decision mechanism section 91 and the 
selection module 94, that is, the action is decided as a 

35 concept. The decided action information command 
information S16 is inputted to the posture transition 
mechanism section 92. 

[0139] The posture transition mechanism section 
92 generates information for shifting to the target pos- 

40 ture or the target motion. 

[0140] As described above, the pet-type robot 23 
causes the action decision mechanism section 91 to 
decide the next action to be taken. However, the current 
action and the next action are not necessarily realized in 

45 the same posture or motion. That is, there is considered 
a case where the current action is realized in a "lying 
posture" and where the next action is realized in a 
"standing posture". In such a case, the transition from 
the "lying posture" to the "standing posture" must be 

so made in order to carry out the next action. The posture 
transition mechanism section 92 is adapted for carrying 
out such transition of the posture or motion. 
[0141] Specifically, the posture transition mecha- 
nism section 92 generates the posture transition infor- 

55 mation S1 8 for shifting the current posture or motion to 
the next posture or motion (the target posture or the tar- 
get motion, or the posture or motion for realizing the 
next action) on the basis of the action command infor- 
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mation S16 supplied from the action decision mecha- 
nism section 91, and sends the posture transition 
information S18 to the control mechanism section 93, 
as shown in Fig. 8. For example, the posture to which 
transition can be made from the current posture is 
decided in accordance with the physical shape of the 
pet-type robot 23 such as the shapes of the trunk and 
limbs, the weight and the coupling state of the respec- 
tive parts, and the mechanism of the actuators 78A to 
78N for the directions and angles of bending of the 
joints. The posture transition information S18 is the 
information for realizing transition in consideration of 
such shape and mechanism. 

[0142] On the basis of the posture transition infor- 
mation S18 thus sent from the posture transition mech- 
anism section 92, the control mechanism section 93 
actually operates the pet-type robot 23. 
[0143] The posture transition mechanism section 
92 has registered therein in advance the posture to 
which transition can be made by the pet-type robot 23 
and the motion in making the transition, and holds such 
information as a graph. The posture transition mecha- 
nism section 92 sends the action command information 
S1 6, supplied from the action decision mechanism sec- 
tion 91 , to the control mechanism section 83 as the pos- 
ture transition information S18. The control mechanism 
section 93 operates in accordance with the posture 
transition information S18 so as to shift to the target 
posture or the target motion. The processing at the pos- 
ture transition mechanism section 92 will now be 
described in detail. 

[0144] For example, there is a case where the pet- 
type robot 23 cannot directly shift to the posture in 
accordance with the contents of the command (action 
command information S16). The postures of the pet- 
type robot 23 are classified into postures to which direct 
transition can be made from the current posture, and 
postures to which transition can be made not directly 
but via a certain motion or posture. 
[0145] The quadrupedal pet-type robot 23 can 
directly shift from the sprawling state to the state of get- 
ting down, but cannot directly shift to the standing pos- 
ture and needs to make two stages of motions, that is, 
drawing the limbs back toward the trunk so as to take 
the lying posture and then standing up. There is also a 
posture that cannot be taken safely. For example, the 
quadrupedal pet-type robot 23 will fall down if it tries to 
raise the forelimbs up in the standing posture. Alterna- 
tively, when a command having the contents of "flutter- 
ing the limbs", which can be done only in the sitting 
posture, is sent in the case where the current posture is 
the sprawling posture (or lying posture), the transition 
from the lying posture to the sitting posture and the 
motion of fluttering the limbs are carried out and the pet- 
type robot 23 may lose its balance and fall down. 
[0146] Therefore, when the action command infor- 
mation S16 supplied from the action decision mecha- 
nism section 91 indicates the posture to which direct 



transition can be made, the posture transition mecha- 
nism section 92 sends the action command information 
S1 6 as it is, as the posture transition information S1 8 to 
the control mechanism section 93. On the other hand, 

5 when the action command information S16 indicates 
the posture to which direct transition cannot be made, 
the posture transition mechanism section 92 generates 
the posture transition information S18 for shifting to the 
target posture (posture instructed by the action com- 

70 mand information S16) via another posture or motion 
that can be taken, and sends this posture transition 
information S18 to the control mechanism section 93. 
Thus, the pet-type robot 23 can avoid any impossible 
attempt to take a posture to which transition cannot be 

75 made or any risk of falling down. Also, the preparation of 
a plurality of motions to reach the target posture or 
motion leads to the abundance of expressions. 
[0147] The pet-type robot 23 is adapted for repre- 
senting the action of the electronic pet in the real world. 

20 Thus, it is essential to consider the current posture or 
the like when making transition to the target motion or 
posture, as described above. It is also essential to con- 
sider the conffict of resources, which will be described 
later. Meanwhile, such consideration is not required in 

25 the virtual electronic pet device 22 adapted for repre- 
senting the action of the electronic pet in the virtual 
world (on the screen). 

[0148] Specifically, the posture transition mecha- 
nism section 92 holds a graph having registered therein 

30 the posture and motion that can be taken by the pet- 
type robot 23 and constituted by the posture and the 
motion for shifting the posture. The posture transition 
mechanism section 92 then searches for a path from 
the current posture to the target posture or the target 

35 motion on the graph on the basis of the action command 
information S16 as the command information, and 
causes the pet -type robot to move in accordance with 
the search result, thus shifting from the current posture 
to the target posture or the target motion. That is, the 

40 posture transition mechanism section 92 registers in 
advance the postures that can be taken by the pet-type 
robot 23, and also records the connection between two 
postures which allow transition. The posture transition 
mechanism section 92 thus makes transition to the tar- 

45 get posture or motion on the basis of the graph and the 
action command information S16 outputted from the 
action decision mechanism section 91 . 
[0149] Specifically, as the above-described graph, 
the posture transition mechanism section 92 uses an 

so algorithm called a directed graph 96 as shown in Fig.1 5. 
The directed graph 96 is constituted by coupling a node 
indicating the posture that can be taken by the pet-type 
robot 23, a directed arc (motion arc) for connecting two 
postures (nodes) which allow transition, and depending 

55 on the case, a motion arc for returning from one node to 
this one node, that is, a self-motion arc indicating the 
motion completed within one node. That is, the posture 
transition mechanism section 92 holds the directed 
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graph 96 constituted by the node as the information 
indicating the posture (standstill posture) of the pet-type 
robot 23, and the directed arc and the self-motion arc as 
the information indicating the motion of the pet-type 
robot 23. The posture transition mechanism section 92 
then regards the posture as point information and 
regards the information of the motion (or action) as 
directed line information. 

[0150] In this case, there may be a plurality of 
directed arcs or self-motion arcs. That is, a plurality of 
arcs may be provided between the nodes (postures) 
which allow transition, and a plurality of self-motion arcs 
may be coupled in one node. 

[0151] When the action command information S16 
is supplied from the action decision mechanism section 
91, the posture transition mechanism section 92 
searches for a path from the current node to the next 
node along the direction of the directed arc so as to con- 
nect the node corresponding to the current posture and 
the node corresponding to the next posture to be taken 
indicated by the action command information S16, and 
sequentially records the nodes located on the path thus 
searched for, thereby making the plan of posture transi- 
tion. Hereinafter, the search for the target node (node 
instructed by the command) or the target arc (arc 
instructed by the command) from the current posture is 
referred to as path search. In this case, the target arc 
may be a directed arc or maybe a self-motion arc. For 
example, in the case where a self-motion arc is the tar- 
get arc, a self-motion is the target (instructed), that is, 
for example, a predetermined performance (motion) is 
instructed. 

[0152] On the basis of the posture transition plan to 
reach the target posture (node) or the target motion 
(directed arc or self-motion arc) obtained by path 
search, the posture transition mechanism section 92 
outputs a control command (posture transition informa- 
tion S1 8) for transition to the control mechanism section 
93 on the subsequent stage. 

[0153] For example, as shown in Fig.16, when the 
action command information S16 representing "Sit" is 
supplied in the case where the current posture is at the 
node DN2 indicating the posture of "getting down", 
direct transition from the node ND2 indicating the pos- 
ture of "getting down" to the node ND5 indicating the 
posture of "sitting" is possible since the directed arc a9 
exists from the node ND2 to the node ND5. Thus, the 
posture transition mechanism section 92 provides the 
posture transition information S18 having the contents 
of "Sit" to the control mechanism section 93, 
[0154] On the other hand, when the action com- 
mand information S16 representing "Walk" is supplied 
in the case where the current posture is at the node 
ND2 indicating the posture of "getting down", since 
direct transition from "getting down" to "walking" is not 
possible, a posture transition plan is made by searching 
for a path to reach the node ND4 indicating the posture 
of "walking" from the node ND2 indicating the posture of 



"getting down". That is, a posture transition plan is made 
such as to select the node ND3 indicating the posture of 
"standing" via the directed arc a2 from the node ND2 
indicating the posture of "getting down" and then to 

5 reach the node ND4 indicating the posture of "walking" 
via the directed arc a3 from the node ND3 indicating the 
posture of "standing". As a result of such a posture tran- 
sition plan, the posture transition mechanism section 92 
outputs the posture transition information S18 having 

70 the contents of "Stand" and then outputs the posture 
transition information S18 having the contents of 
"Walk", to the control mechanism section 93. 
[0155] The pet-type robot 23 is capable of sepa- 
rately operating the individual constituent parts. That is, 

w commands can be executed with respect to each of the 
constituent parts. Such constituent parts of the robot 
device 1 (whole body) may be generally the head por- 
tion 61, the limb portions 63, and the tail portion 64, as 
shown in Fig. 17. 

20 [0156] In the pet-type robot 23 thus constituted, the 
tail portion 64 and the head portion 61 can be operated 
separately. That is, these portions can be operated sep- 
arately since there is no conflict of resources. On the 
other hand, the whole body of the pet-type robot 23 and 

25 the head portion 61 cannot be operated separately. 
That is, the whole body and the head portion cannot be 
operated separately since there is a conflict of 
resources. For example, while a command for the 
motion of the whole body including the motion of the 

30 head portion 61 is executed, a command for the head 
portion 61 cannot be executed. It is possible for the pet- 
type robot to wag the tail portion 64 while shaking the 
head portion 61 , but it is impossible to shake the head 
portion 61 while doing a certain performance using the 

35 whole body. The occurrence of such a conflict of 
resources is a problem proper to the pet-type robot 23, 
which constitutes the electronic pet in the real world. 
[0157] The following table shows exemplary combi- 
nations of parts which cause and do not cause a conflict 

40 of resources with respect to the action command infor- 
mation S16 sent from the action decision mechanism 
section 91. 



45 



50 



Combination of Parts 


Conflict of Resources 


Head, Tail 


No 


Head, Whole Body 


Yes 


Limbs, Whole Body 


Yes 


Head, Limbs, Tail 


No 



55 [0158] In the case where the commands which 
cause a conflict of resources is thus supplied, either the 
command for the motion of the whole body 23 or the 
command for the motion of the head portion 61 must be 
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executed preferentially. The processing for dealing with 
such commands will now be described. 
[0159] In the case of preferentially executing one of 
the commands because there is a conflict of resources, 
for example, in the case of completing the motion of the 
whole body 23 and then executing the command forthe 
head portion 61, the motion of the head portion 61 is 
started in the last posture which is reached as a result 
of the motion of the whole body 23. However, the last 
posture after the motion of the whole body 23 is not nec- 
essarily a posture suitable for starting a motion such as 
shaking the head portion 61 . If the motion of the head 
portion 61 is started when the last posture after the 
motion of the whole body 23 is not a posture suitable for 
starting the motion of the head portion 61 , that is, when 
the postures between which transition is made are dis- 
continuous due to the different commands, the head 
portion 61 may move abruptly, thus generating an 
unnatural motion. This problem is caused in the case 
where the transition from the current posture (or motion) 
to the target posture (or motion) extends over the whole 
body and the individual constituent parts of the pet-type 
robot 23 and where a network (graph) including the 
node and arc constituted for controlling the whole body 
of the pet-type robot 23 and networks (graphs) including 
the node and arc constituted for controlling the individ- 
ual constituent parts of the pet-type robot 23 are sepa- 
rately constituted without having any relation with each 
other. 

[0160] The unnatural motion, generated by the pet- 
type robot 23 due to the discontinuity of the postures 
between which transition is made, is eliminated by mak- 
ing a posture transition plan so as to smoothly connect- 
ing the transition motions on the graph. Specifically, a 
basic posture shared on the graphs of the whole body 
and the constituent parts is employed to make the pos- 
ture transition plan. 

[0161] Information of a network used forthe posture 
transition plan of the pet-type robot 23 will be described 
hereinafter with reference to the case where it is consti- 
tuted by the information (graph) of the network of the 
whole body and the information (graphs) of the net- 
works of the individual constituent parts, as shown in 
Fig. 1 8A. For example, the information used for the pos- 
ture transition plan consisting of the information (graph) 
of the network of the whole body and the information 
(graphs) of the networks of the individual constituent 
parts is constituted within the posture transition mecha- 
nism section 92, as shown in Fig. 12. 
[0162] The basic posture is a posture to which tran- 
sition is temporarily made in order to shift the state 
between the motion of the whole body and the motion of 
each constituent part. The basic posture may be, for 
example, a sitting posture as shown in Fig.18B. The 
procedure for smoothly connecting the transition 
motions in the case where the sitting posture is 
employed as the basic posture will now be described. 
[0163] Specifically, it is the case where the current 



posture is understood as the posture NDaO on the 
graph of the whole body and where a motion a2 of the 
head portion is to be executed as a target motion, as 
shown in Fig. 19. 

5 [0164] On the graph of the whole body, a directed 
arc aO for shifting the posture of the whole body of the 
pet-type robot 23 from the current posture NDaO to a 
basic posture NDab is selected. In the case where the 
whole body is in the basic posture, the state (node) of 

10 the basic posture is also grasped on the graphs of the 
head portion, the limb portions, and the tail portion. 
[0165] On the graph of the head portion, an opti- 
mum directed arc a1 from the state of a basic posture 
NDhb is selected, and a path to reach the target motion 

75 (self-motion arc) a2 of the head portion 61 is decided. 
[0166] In accordance with such procedure, the 
selection of the transition path (posture transition plan) 
so as to smoothly connects the motions of the whole 
body and each constituent part is carried out on the 

20 graph of the whole body and the graph of the head por- 
tion. Then, the posture transition mechanism section 92 
outputs the posture transition information S18 to the 
control mechanism section 93 on the basis of the pos- 
ture transition plan. 

25 [0167] In the above-described example, the 
motions are smoothly connected the motion of the 
whole body to the motion of each constituent part. An 
example in which the motions are smoothly connected 
from the motion of each constituent part to the motion of 

30 the whole body will now be described. Specifically, it is 
the case where the posture of the head portion 61 is 
grasped as a posture NDhO on the graph of the head 
portion while the posture of the limb portion 63 is 
grasped as a posture NDfO on the graph of the limb por- 

35 tion and where a motion a4 of the whole body is to be 
executed as a target motion, as shown m Fig. 20. 
[0168] On the graph of the head portion, a directed 
arc aO for shifting the posture of the head portion 61 
from the current posture NDhO to a basic posture NDAB 

40 is selected. On the graph of the limb portion, directed 
arcs a1 and a2 for shifting the posture of the limb por- 
tion 63 from the current posture NDfO to a basic posture 
NDfb via a posture NDf1 are selected. It is assumed that 
the tail portion 64 is originally in its basic posture. In the 

45 case where the respective constituent parts are thus in 
the basic postures, the basic posture is also grasped on 
the graph of the whole body. 

[0169] On the graph of the whole body, an optimum 
directed arc a3 from the state of the basic posture NDhb 

so is selected and a path to reach the target motion (self- 
motion arc) a4 of the whole body is decided. 
[0170] For example, the motion of each constituent 
part may be executed simultaneously with the motion of 
another constituent part in the transition to the basic 

55 posture, and the motions of the respective constituent 
parts may be executed with some limitations. For exam- 
ple, certain timing for carrying out the motion may be 
provided. 
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[0171] Specifically, if a command for the motion of 
the whole body 23 is given while the pet-type robot is 
doing a certain performance with its head portion 61, 
transition of the head portion 61 to the basic posture 
NDhb cannot be made since the pet-type robot is doing 
a performance with the head portion 61. Therefore, the 
limb portion 63 is first set in the state of the basic pos- 
ture NDfb and then the head portion 61 on completion 
of the performance is shifted to the state of the basic 
posture NDhb. 

[0172] The individual constituent parts can also be 
moved in consideration of the balance of the posture of 
the whole body 23. For example, if the head portion 61 
and the limb portion 63 are simultaneously shifted, or if 
the head portion 61 is first shifted to the state of the 
basic posture NDhb, the pet-type robot 23 loses its bal- 
ance and falls down. In such a case, the limb portion 63 
is first set to the state of the basic posture NDfb and 
then the head portion 61 is shifted to the state of the 
basic posture NDhb. 

[0173] By thus making the posture transition plan 
which allows temporary transition to the basic posture, 
the motions can be smoothly connected. 
[0174] The posture transition mechanism section 

92 searches for an optimum path to the target posture 
or motion indicated by the command so as to make the 
posture transition plan on the basis of the action com- 
mand information S16 sent from the action decision 
mechanism section 91, and outputs the posture transi- 
tion information S18 to the control mechanism section 

93 in accordance with the posture transition plan, as 
described above. 

[0175] Thus, the pet-type robot 23 can avoid any 
impossible attempt to take a posture to which transition 
cannot be made or any risk of falling down. Also, the 
preparation of a plurality of motions to reach the target 
posture or motion leads to the abundance of expres- 
sions. 

[0176] The control mechanism section 93 gener- 
ates a control signal S5 for driving the actuators 78A to 
78N on the basis of the posture transition information 
S1 8, as shown in Fig. 8, and sends the control signal S5 
to the actuators 78A to 78N so as to drive the actuators 
78A to 78N, thus causing the pet-type robot 23 to make 
a desired motion. 

[0177] Specifically, in the case where the transition 
of the posture or motion is necessary for taking the next 
action, the control mechanism section 93 controls the 
actuators 78A to 78N on the basis of the posture transi- 
tion information S18 in accordance with the posture 
transition plan sent from the posture transition mecha- 
nism section 92, thus shifting the pet-type robot 23 to a 
desired posture or motion. Then, the control mechanism 
section 93 controls the actuators 78A to 78N on the 
basis of the subsequently supplied information of the 
action selected by the selection module 94, thus caus- 
ing the pet-type robot 23 to carry out the selected 
action, for example, a performance. 



[0178] In the case where the transition of the pos- 
ture or motion is not necessary for taking the next 
action, the control mechanism section 93 controls the 
actuators 78A to 78N on the basis of the subsequently 

5 supplied information of the action selected by the selec- 
tion module 94, thus causing the pet-type robot 23 to 
carry out the selected action (e.g., a performance), with- 
out carrying out the transition of the posture or motion. 
[0179] The specific structure of the pet-type robot 

10 23 is described above. Such a pet-type robot 23 can 
change the state of the emotion and the state of the 
instinct using the emotion models and the instinct mod- 
els on the basis of the external information (environ- 
ment or external elements) or the internal information 

is (internal elements) and can act in accordance with the 
state of the emotion and the state of the instinct. 
[0180] Thus, since parameters corresponding to 
the emotion and instinct of the electronic pet are con- 
tained in the pet-type robot 23, a short-tempered elec- 

20 tronic pet or a crybaby electronic pet can be realized. It 
is thus possible to cause the electronic pet to take an 
action in consideration of such an emotion or action, 
and to change the emotion in accordance with the 
action carried out by the electronic pet itself. Specifi- 
cs cally, when the electronic pet is hungry and thus has the 
emotion of anger at a high level, it is possible to cause 
the electronic pet to take an action like crying or falling 
asleep and to sooth the increased emotion of anger in 
accordance with that action. Thus, an electronic pet with 

30 more reality is realized. 

[0181] In the embodiment, the structure shown in 
Figs. 7 and 8 is employed as the specific structure of the 
pet-type robot 23. However, it is a matter of course that 
the structure shown in Figs. 7 and 8 can be applied to 

35 the virtual electronic pet device 22. For example, in the 
case where the structure is applied to the virtual elec- 
tronic pet device 22, an equivalent technique is 
employed for inappropriate portions, thus realizing the 
virtual electronic pet device 22 as shown in Figs.7 and 

40 8. For example, in the virtual electronic pet device 22, 
since the motion section (actuators 78 A to 78 N) is not 
required, it is changed to an output to the image display 
section, thus realizing the virtual electronic pet device 
22. In the virtual electronic pet device 22, the mecha- 

45 nism for making the posture transition plan or for solving 
the conflict of resources is not required, either. 
[0182] Thus, in the virtual world (on the display 
image), an electronic pet which changes the state of the 
emotion and the state of the instinct on the basis of the 

50 external or internal information and acts in accordance 
with the state of the emotion or the state of the instinct 
can be realized similarly. 

[0183] In the electronic pet system, as described 
above, an electronic pet which stores the pet character- 
55 istic information in the individual information storage 
section 1 (IC card 21) and has the emotion or instinct 
based on the stored pet characteristic information is 
realized. 
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[0184] For example, in the case where the virtual 
electronic pet device 22 or the pet-type robot 23 is con- 
stituted as described above, the pet characteristic infor- 
mation stored in the individual information storage 
section 1 (IC card 21) may be the emotion parameters 5 
and the instinct parameters decided by the above- 
described emotion models and the instinct models. In 
this case, the emotion parameters and the instinct 
parameters are stored in the individual information stor- 
age section 1 , as shown in Fig. 21 . 10 
[0185] As the pet characteristic information, the 
transition probability in deciding actions can also be 
stored in the individual information storage section 1 . 
[0186] As described with reference to Fig. 13, using 
the finite probability automaton, actions are decided in 75 
terms of the probability on the basis of the transition 
probabilities P1 to Pn which are set for respective arcs 
ARC1 to ARCnl connecting the respective nodes 
NODEO to NODEn and indicating to which node 
NODEO to NODEn the transition should be made from 20 
one node (state) NODEO to NODEn, and these transi- 
tion probabilities P1 to Pn can also be stored in the indi- 
vidual information storage section 1. The transition 
probabilities P1 to Pn can be changed in accordance 
with the state of the emotion, the state of the instinct, or 25 
learning. Therefore, the individuality of the electronic 
pet can be realized by storing the transition probabili- 
ties. 

[0187] The pet characteristic information stored in 
the individual information storage section 1 is not limited 30 
to the above-described example. 
[0188] For example, the name of the electronic pet, 
the name of the owner (the name of the keeper (user)), 
the time of growth, the number of remaining metempsy- 
choses, and the species may also be employed. The 35 
time of growth is the elapsed time from the birth of the 
electronic pet up to the present. The electronic pet (its 
soul) comes back to life after death, and the number of 
remaining metempsychoses is the information indicat- 
ing the number of remaining times for coming back to 40 
life. Specifically, it is the number of times for reset. The 
species is the information indicating the kind of the elec- 
tronic pet such as dogs, cats, or birds. The kind of the 
electronic pet need not necessarily be an existent ani- 
mal. 45 
[0189] The pet characteristic information may also 
be learning information. The learning information is the 
information related to whether the electronic pet can do 
a predetermined performance or not. That is, the elec- 
tronic pet is enabled to learn several types of perform- 50 
ances and the learning information indicates whether 
the electronic pet can do each type of performance. 
[0190] In the present embodiment, since the inter- 
nal information is stored on the IC card 21 that can be 
inserted to and ejected from the virtual electronic pet 55 
device 22 or the pet-type robot 23, the electronic pet 
can be enjoyed in a form suitable for the user's environ- 
ment. 
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[0191] In the present embodiment, the IC card 21 is 
loaded in the virtual electronic pet device 22 or the pet- 
type robot 23 so as to cause the virtual electronic pet 
device 22 or the pet-type robot 23 to function as the 
electronic pet. However, the IC card 21 can also be 
loaded into a typical computer or the like, and it is thus 
possible to cause the computer to function as the elec- 
tronic pet. 

[0192] In the present embodiment, the present 
invention is described with respect to the electronic pet. 
However, the present invention can also be applied to 
other living objects than the electronic pet (e.g., plant 
object or the like). 

[0193] Moreover, in the present embodiment, the 
pet characteristic information is stored on the IC card. 
However, as the storage means for storing the pet char- 
acteristic information, portable storage means that can 
be inserted to and ejected from the device can be 
employed, such as a memory card, an optical card, a 
magneto-optical disc, and a magnetic disk. 
[0194] In addition, in the present embodiment, the 
individual information storage section 1 storing the pet 
characteristic information can be inserted to and 
ejected from the body section 2. However, it is also pos- 
sible to provide a memory (built-in storage medium or 
storage unit) that can be inserted to and ejected from 
the body section 2 and to store the pet characteristic 
information into that memory. In this case, the individual 
information storage section 1 and the body section 2 
transmits the pet characteristic information by using var- 
ious types of communication means, for example, a 
communication cable, radio transmission, or infrared 
rays. 

[0195] In the virtual electronic pet device 22, the 
electronic pet is a virtual existence displayed on the 
monitor and therefore its appearance is easily changed. 
However, it is difficult for the pet-type robot 23 to change 
its appearance. Therefore, in the pet-type robot 23, the 
information related to the appearance, of the pet char- 
acteristic information, is basically ignored. When the 
species of the pet characteristic information indicates 
birds in the case where the pet-type robot 23 is in the 
shape of a dog, it is possible to cause the pet-type robot 
23 to request a change of parts for those of a bird (for 
example, by means of a synthetic voice). 
[0196] A specific example of the IC card that can be 
inserted and ejected, used in the above-described first 
embodiment, is shown in Figs.22 to 24. IC cards of var- 
ious shapes are currently standardized and the present 
invention is applicable to any of such IC cards. In the 
present embodiment, a stick-shaped IC card is 
employed, for example. 

[0197] The stick-shaped IC card can be inserted 
and ejected, as described above. When the user inserts 
the stick-shaped IC card into the slot 23A of the pet-type 
robot 23 or the slot 22A of the virtual electronic pet 
device 22, the user will be at a loss for determining how 
deep the user can insert the IC card. That is, when load- 
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ing the IC card into the slot 23A of the pet-type robot 23 
or the slot 22A of the virtual electronic pet device 22, it 
is convenient if the user can feel the loading by a load- 
ing sound (a clicking sound or the like) or if the pet-type 
robot 23 or the virtual electronic pet device 22 has an IC 
card lock/ejection function. However, if the user cannot 
feel the loading or if the lock/ejection function is pro- 
vided, the user might break the IC card by forcibly 
inserting the IC card into the slot, or cannot carry out 
transmission/reception of data because of insufficient 
insertion of the iC card. 

[0198] Thus, in the present embodiment, color dis- 
crimination for indicating a predetermined insertion 
position is carried out on an IC card 131, as shown in 
Fig. 22. Specifically, as the color of a portion 134 which 
should be out of the slot and the color of a portion 133 
which should be inserted and kept in the slot are made 
different (color discrimination is made), the user can vis- 
ually recognize the state of the accurately loaded IC 
card when the IC card 131 is inserted in the slot 23A of 
the pet-type robot 23 or the slot 22A of the virtual elec- 
tronic pet device 22. Although Fig. 22 shows an example 
in which color discrimination is made on a label 132 
attached to the body of the IC card 131, color discrimi- 
nation may also be made on the body of the IC card 1 31 
itself. In the present invention, the colors of the portions 
1 33 and 1 34 for color discrimination are not particularly 
limited, and arbitrary colors can be used. 
[0199] Although color discrimination is made on the 
IC card 131 in the example of Fig. 22, it is also possible 
to provide an arrow mark 135 as shown in Fig. 23, 
together with or in place of the color discrimination on 
the IC card 131. Fig.23 shows an example in which the 
color of a portion 134 to be out of the slot and the color 
of a portion 133 to be inserted and kept in the slot are 
made different similarly to the example of Fig.22 and in 
which the arrow mark 135 is added to the portion 134 
which should be out of the slot. By thus providing the 
arrow mark 135, the user not only can accurately load 
the IC card 131 into the slot but also can easily recog- 
nize the loading direction of the IC card 131. Although 
Fig.23 shows the example in which color discrimination 
is made on the label 1 32 attached to the body of the IC 
card 131 and in which the arrow mark 135 is added to 
the label 132, the arrow mark 135 may also be provided 
on the body of the IC card 1 31 itself. 
[0200] As a still another example, it is possible to 
provide a line 136 indicating the boundary position as 
shown in Fig.24, together with or in place of the color 
discrimination. Fig.24 shows an example in which the 
color of a portion 1 34 to be out of the slot and the color 
of a portion 133 to be inserted and kept in the slot are 
made different similarly to the example of Fig.22 and in 
which the line 136 is added at the boundary position 
between the portion 134 to be out of the slot and the 
portion 133 to be kept in the slot. By thus providing the 
line 136, the user can accurately load the IC card 131 
into the slot. Although Fig.24 shows the example in 



which color discrimination is made on the label 132 
attached to the body of the IC card 131 and in which the 
line 1 36 is added to the label 1 32, the line 1 36 may also 
be provided on the body of the IC card 1 31 itself. 
5 [0201] Fig. 25 shows the state where the IC card 
131 as described above is accurately loaded in the slot 
of the pet-type robot 23 or the virtual electronic pet 
device 22. 

[0202] Fig. 26 shows an example of the label 132 

io attached to the body of the IC card 131. In the example 
of the label 132 shown in Fig.26, only color discrimina- 
tion is made as in the example of Fig.22, and the color 
of the portion 1 34 to be out of the slot when the IC card 
131 is inserted in the slot and the color of the portion 

15 1 33 to be inserted and kept in the slot are discriminated. 
[0203] Fig.27A shows a bottom view corresponding 
to the plan views of the IC card 1 31 shown in Figs. 22 to 
24, and Fig.27B shows aside view thereof. On this IC 
card 131, a terminal portion 137 connected with a data 

20 transmission/reception terminal provided in the slot 23A 
of the pet-type robot 23 or the slot 22A of the virtual 
electronic pet device 22, and a write inhibit lock 138 for 
inhibiting data writing are provided. The label 132 of 
Fig.26 is attached in such a manner that the portion 134 

25 to be out of the slot is turned up to cover the bottom side 
of the ICcard 131. 

[0204] A second embodiment of the present inven- 
tion will now be described. 

[0205] In the first embodiment, storage of the indi- 

30 vidual information storage section 1 (pet characteristic 
information of the electronic pet) in a storage medium 
such as an IC card that can be inserted and ejected is 
enabled, and insertion/ejection of the IC card to/from 
the slot 22 A of the virtual electronic pet device 22 or the 

35 slot 23A of the pet-type robot 23 is enabled, thus ena- 
bling transfer of the pet characteristic information 
between the virtual electronic pet device 22 and the pet- 
type robot 23. In the second embodiment, however, 
transfer of the pet characteristic information is enabled 

40 by communication without using an IC card. 

[0206] Fig. 28 shows an example of connection 
according to the second embodiment. 
[0207] A virtual electronic pet device 202 shown in 
Fig.28 is basically the same as the above-described vir- 

45 tual electronic pet device 22, and a pet-type robot 204 
shown in Fig.28 is basically the same as the above- 
described pet-type robot 23. In the second embodi- 
ment, however, both the virtual electronic pet device 
202 and the pet-type robot 204 have a communication 

50 processing section which enables replacement of the 
pet characteristic information of the above-described 
individual information storage section 1 by communica- 
tion. The pet characteristic information communicated 
via the communication processing section can be 

55 stored onto an IC card as described above and can also 
be stored into data storage sections 203 and 205 which 
are internally provided. (In Fig.28, it is shown that they 
are outside of the virtual electronic pet device 202 and 
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the pet-type robot 204, respectively, but they are actu- 
ally provided therein.) In the second embodiment, the 
pet characteristic information is stored into the internally 
provided data storage sections. 

[0208] In the example of connection shown in s 
Fig. 28, the virtual electronic pet device 202 and the pet- 
type robot 204 are connected to a personal computer 
201, and the personal computer 201 is connected a net- 
work such as the Internet 200. Meanwhile, it is also pos- 
sible to directly connect the virtual electronic pet device 10 
202 to the pet-type robot 204 without using the personal 
computer 201 , or to directly connect them to the Internet 
200 without using the personal computer 201. Moreo- 
ver, in the second embodiment, it is possible to connect 
the virtual electronic pet devices 202 to each other or is 
the pet-type robots 204 to each other. 
[0209] The electronic pet can be expressed not only 
by the virtual electronic pet device 202 or the pet-type 
robot 204 but also on the personal computer 201 . In this 
case, by installing an application program for realizing 20 
the above-described electronic pet on the personal 
computer 201 and starting the application program for 
the electronic pet, it becomes possible to keep the elec- 
tronic pet on the personal computer 201. Therefore, 
also the pet characteristic information of the electronic 25 
pet is stored into the personal computer 201 . 
[0210] In the second embodiment, as the connec- 
tion form in the case of transmitting and receiving the 
pet characteristic information between the virtual elec- 
tronic pet device 202 and the pet-type robot 204, vari- 30 
ous forms of connection can be considered such as 
connection via a cable, connection via radio transmis- 
sion, and connection by infrared rays. The present 
invention is applicable to any connection form including 
such connection via a cable, radio transmission, and 35 
infrared rays. 

[0211] Fig.29 shows the structure of a main portion 
(communication processing section) of the pet-type 
robot 204, which enables transfer of the pet characteris- 
tic information by communication, as described above. 40 
The pet-type robot 204 has the structure as shown in 
Figs.3, 5 and 7, but only the portion (communication 
processing section) necessary for communication of the 
pet characteristic information is shown in Fig.29. In the 
example of Fig.29, connection by infrared rays (IrDa), 45 
serial cable connection, and radio connection are 
employed as exemplary connection forms. 
[0212] In Fig.29, a RAM 211 corresponds to the 
RAM 33 of Fig. 5, and a processing unit 212 corre- 
sponds to the CPU 31 of Fig.5. so 
[0213] The communication processing section 210 
of the pet-type robot 204 shown in Fig.29 has an infra- 
red (IrDa) transmission/reception section 217, a serial 
port section 218, and a radio transmission/reception 
section 21 9, as communication means connected to the 55 
outside (e.g., the virtual electronic pet device, the per- 
sonal computer, or the Internet) for transmitting and 
receiving the pet characteristic information. These com- 



munication means are connected to a communication 
control section 215. 

[0214] The communication control section 215 is 
controlled by the processing unit 212 corresponding to 
the CPU 31 of Fig.5, and operates in accordance with a 
communication clock from a clock generation section 
216, thus transmitting and receiving data in accordance 
with a communication protocol corresponding to the 
connection form of the communication means. 
[0215] The data to be transmitted is read out from 
the RAM 21 1 under the control of the processing unit 
212, then temporarily stored in a transmitted data stor- 
age section 213 as a transmission buffer, and then 
transmitted from the communication means via the 
communication control section 215. The data received 
by the communication means is temporarily stored in a 
received data storage section 214 as a reception buffer 
via the communication control section 215 and then 
sent to the RAM 211. 

[0216] Fig. 30 shows the specific appearance of a 
virtual electronic pet device used in the embodiment of 
the present invention. 

[0217] A virtual electronic pet device 220 shown in 
Fig. 30 has a monitor 222 for displaying the electronic 
pet, a speaker 223 for outputting a voice, a microphone 
224 for picking up a voice, operation buttons 226 for the 
user to input various operations to the device 220, LEDs 
(light-emitting diodes) 225 which are lit in accordance 
with the operated buttons, and a talk switch 221 for 
instructing analysis of the voice picked up from the 
microphone 224 as described above. 
[0218] The virtual electronic pet device 220 as 
shown in Fig. 30 has an internal hardware structure as 
shown in Fig.31. The structure shown in Fig. 31 has 
basically the same function as the structure of Fig.4, but 
a communication interface 1 1 2 is provided as the struc- 
ture to enable communication of the pet characteristic 
information as in the second embodiment. 
[0219] In Fig.31, a processing unit 113 is adapted 
for carrying out various types of processing in accord- 
ance with programs stored in a ROM 116. The ROM 
116 stores programs to be executed by the processing 
unit 113 and data necessary for executing the pro- 
grams. A RAM 1 15 stores data necessary for the oper- 
ation of the processing unit 113. 
[0220] The communication interface 112 functions 
as an interface corresponding to the communication 
means and the communication control section 215 
shown in Fig.29. 

[0221] The microphone 224 converts a voice input- 
ted thereto to an audio signal as an analog electric sig- 
nal and supplies the audio signal to an A/D converter 
101. The A/D converter 101 performs A/D conversion 
on the analog audio signal from the microphone 224 
and outputs a digital audio signal to a voice recognition 
device 1 04. 

[0222] The voice recognition device 104 carries out 
linear prediction analysis of the audio signal inputted 
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thereto so as to extract the characteristic quantity, and 
carries out voice recognition based on, for example, the 
HMM method. A program executed by the voice recog- 
nition device 104 for carrying out voice recognition and 
word models as the objects of voice recognition are 
stored, for example, in a ROM 103. In the ROM 103, 
particularly the word models used for the keeper to talk 
to the pet are stored as the word models to be the 
objects of voice recognition. The method of acoustic 
analysis is not limited to the linear prediction analysis, 
and the method of voice recognition is not limited to the 
HMM method. ARAM 102 stores data necessary for the 
operation of the voice recognition device 104. 
[0223] A key section corresponds to the operation 
buttons 226 and the talk switch 221 shown in Fig.30. A 
signal outputted from the key section 221,226 as the 
user operates the key section is inputted to the process- 
ing unit 113. Thus, the processing unit 113 recognizes 
the buttons and keys operated by the user. For example, 
when the operation buttons 226 in the key section are 
operated, various types of inputs are provided to the 
electronic pet in response to the operations. When the 
talk switch 221 in the key section is pressed, the 
processing unit 1 13 causes the voice recognition device 
1 04 to start voice recognition of the voice inputted from 
the microphone 224. 

[0224] A sensor 227 is a sensor for detecting the 
state of the external environment such as the sound, 
light, and temperature. A detection signal from this sen- 
sor 227 is converted to a digital signal by an A/D con- 
verter 1 05 and then sent to the processing unit 1 1 3. The 
processing unit 113 controls the reaction of the elec- 
tronic pet on the basis of the detection data obtained 
from the sensor 227. 

[0225] A voice synthesizer 1 1 4 synthesizes a voice 
to be outputted by the electronic pet under the control of 
the processing unit 1 13. A program for the voice synthe- 
sizer 1 14 to carry out voice synthesis and data as the 
basis for voice synthesis are stored, for example, in a 
ROM 107. In the ROM 107, data for synthesizing vari- 
ous types pf voices to be outputted by the electronic pet 
are stored. A ROM 106 stores data necessary for the 
operation of the voice synthesizer 114. 
[0226] A D/A converter 1 08 performs D/A conver- 
sion on the audio data synthesized by the voice synthe- 
sizer 1 14 so as to generate an analog audio signal, and 
supplies the analog audio signal to the speaker 223. 
The speaker 223 includes an amplifier so as to amplify 
the audio signal from the D/A converter 108 and then 
output the amplified audio signal. 
[0227] A liquid crystal display (LCD) section 222 
includes a liquid crystal controller which is controlled by 
the processing unit 113 and displays various images 
(e.g., images of the electronic pet) and characters. 
[0228] Fig.32 shows the essential internal struc- 
tures of the virtual electronic pet device 220 and the pet- 
type robot 204 in the case where the virtual electronic 
pet device 220 and the pet-type robot 204 are con- 



nected with each other via a USB (universal serial bus) 
cable as an exemplary serial data cable so as to transfer 
the pet characteristic information. 
[0229] In Fig.32, a CPU 231 of the virtual electronic 

5 pet device 220 corresponds to the processing unit 113 
of Fig.31, a RAM 236 corresponds to the RAM 115 of 
Fig.31 , and a ROM 235 corresponds to the ROM 1 1 6 of 
Fig.31 . An image controller 234 corresponds to the liq- 
uid crystal controller included in the liquid crystal display 

10 section 222 of Fig.31 . A data storage section 233 stores 
the pet characteristic information. The pet characteristic 
information is transmitted to and received from the pet- 
type robot 204 via the USB cable connected to a USB 
port 232. 

15 [0230] A CPU 241 of the pet-type robot 204 corre- 
sponds to the processing unit 212 of Fig. 29, a RAM 146 
corresponds to the RAM 21 1 of Fig.29, and a ROM 245 
corresponds to the ROM 32 of Fig.29. A mechanical 
controller 244 controls the driving mechanism 52 of 

20 Fig. 5 under the control of the CPU 241 . A data storage 
section 243 stores the pet characteristic information. 
The pet characteristic information is transmitted to and 
received from the virtual electronic pet device 220 via 
the USB cable connected to a USB port 242. 

25 [0231] Fig.33 shows the essential internal struc- 
tures of the virtual electronic pet device 220 and the pet- 
type robot 204 in the case where the virtual electronic 
pet device 220 and the pet-type robot 204 are con- 
nected with each other by infrared rays via an infrared 

30 (IrDA) transmission/reception section so as to transfer 
the pet characteristic information. In Fig.33, portions 
similar to those of Fig.32 are denoted by the same 
numerals and will not be described further in detail. 
[0232] In the example of Fig.33, an infrared trans- 

35 mission/reception section 237 of the virtual electronic 
pet device 220 is provided in the communication inter- 
face 1 12 of Fig.31 . The pet characteristic information is 
transmitted and received between the infrared transmis- 
sion/reception section 237 and an infrared transmis- 

40 sion/reception section 247 of the pet-type robot 204. 
[0233] The infrared transmission/reception section 
247 of the pet-type robot 204 corresponds to the infra- 
red transmission/reception section 21 7 shown in Fig.29. 
The pet characteristic information is transmitted and 

45 received between the infrared transmission/reception 
section 247 and the virtual electronic pet device 220. 
[0234] Fig. 34 shows the essential internal struc- 
tures of the virtual electronic pet device 220 and the pet- 
type robot 204 in the case where the virtual electronic 

so pet device 220 and the pet-type robot 204 are con- 
nected with each other by radio waves via a radio trans- 
mission/reception section so as to transfer the pet 
characteristic information. In Fig.34, portions similar to 
those of Fig.32 are denoted by the same numerals and 

55 will not be described further in detail. 

[0235] In the example of Fig.34, a radio transmis- 
sion/reception section 238 of the virtual electronic pet 
device 220 is provided in the communication interface 
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112 of Fig. 31. The pet characteristic information is 
transmitted and received between the radio transmis- 
sion/reception section 238 and a radio transmis- 
sion/reception section 248 of the pet-type robot 204. 
[0236] The radio transmission/reception section 
248 of the pet-type robot 204 corresponds to the radio 
transmission/reception section 219 shown in Fig.29. 
The pet characteristic information is transmitted and 
received between the radio transmission/reception sec- 
tion 248 and the radio transmission/reception section 
238 of the virtual electronic pet device 220. 
[0237] Specifically, as the radio transmission/recep- 
tion section 248 of the pet-type robot 204 and the radio 
transmission/reception section 238 of the virtual elec- 
tronic pet device 220, Bluetooth modules 248 and 238 
can be used, respectively, as shown in Fig.35. 
[0238] The Bluetooth is a radio interface using ISM 
(industrial Scientific Medical) band of 2.4 GHz which 
does not require permission as the carrier frequency. 
The Bluetooth modules 248 and 238 employ this Blue- 
tooth radio interface. The schematic structure of the 
Bluetooth will be described as follows. 
[0239] The Bluetooth uses a spread spectrum tech- 
nique in accordance with a frequency hopping system. 
It uses 79 channels each having a width of 1 MHZ and 
capable of switching the channel 1 600 times per second 
at the maximum. Thus, interference with other radio 
communications is prevented. Carrier sense is not car- 
ried out since hopping is switched to high-speed hop- 
ping. 

[0240] The maximum data transmission speed is 1 
Mbits/sec. The multiplexing method for packets can deal 
with both TDD (time division duplex) circuit switching 
and packet switching. While asynchronous transmission 
is carried out, a maximum of three audio channels each 
having 64 kbits/sec can be secured simultaneously. 
[0241] The Bluetooth-compatible equipments are 
classified into a "master" for deciding the frequency 
hopping pattern and a maximum of seven "slaves" 
accompanying the master. A sub-net constituted by the 
master and several slaves is called "pico-net". Since the 
master can be a slave of the pico-net, it is possible to 
form a network by sequentially connecting pico-nets. 
For example, such a network structure is called stacker 
net. In the pico-net or the stacker net, communications 
and the state of equipments are managed using an 8-bit 
MAC address. 

[0242] The Bluetooth equipment deals with several 
modes of different dissipation powers, depending on the 
state of participation in the communication. By frag- 
menting the mode in the specification, the dissipation 
power is reduced. 

[0243] The link between the master and the slaves 
is set by the Bluetooth as follows. First, the master 
transmits "Inquiry", which is a message including a key 
for connection or the like, at an interval of 625 jus. On the 
slave side, since the channel is constantly switched in 
accordance with the hopping pattern, synchronization is 



made approximately in two seconds. Thus, the master 
recognizes the slave, and the slave obtains 3-bit "Active 
member address" and enters the pico-net. "Active 
member address" is address information of 3 bits alio- 
5 cated to the equipment which communicates with the 
master. As this "Active member address" is allocated, 
the pico-net is formed. 

[0244] After that, the master sends a "Page" mes- 
sage to the slave. The slave the operates in the hopping 

10 pattern decided by the master. 

[0245] After that, authentication is carried out. An 
encryption key used for authentication is produced by 
the exclusive OR of a random number generated by the 
master and the MAC address of the slave. On comple- 

75 tion of the authentication, a dedicated key is provided to 
simplify the subsequent processing. Then, transmission 
and reception of data is started. 
[0246] The foregoing is the schematic structure of 
the Bluetooth. The pet-type robot 204 and the virtual 

20 electronic pet device 220 can have the Bluetooth mod- 
ules 248 and 238 employing such Bluetooth radio inter- 
faces, respectively, as the radio transmission/reception 
sections. 

[0247] Fig. 36 shows the essential internal struc- 

25 tures of the personal computer 201 and the pet-type 
robot 204 in the case where the personal computer 201 
and the pet-type robot 204 are connected with each 
other by a USB cable as an exemplary serial data cable 
so as to enable transmission and reception of the pet 

30 characteristic information via the personal computer 
201 and the Internet 200. In Fig. 36, portions similar to 
those of Fig.32 are denoted by the same numerals and 
will not be described further in detail. 
[0248] In the example of Fig.36, a CPU 251 of the 

35 personal computer 201 corresponds to a processor unit, 
and a ROM 255, a RAM 256, and a USB port 252 are 
generally provided in the personal computer. A data 
storage section 253 corresponds to a hard disk, for 
example. This personal computer 201 transfers to the 

40 Internet 200 the pet characteristic information transmit- 
ted from the pet-type robot 204 via the USB cable, and 
transfers the pet characteristic information received 
from the Internet 200 to the pet-type robot 204 via the 
USB cable. 

45 [0249] Fig. 37 shows the essential internal struc- 
tures of the personal computer 201 and the pet-type 
robot 204 in the case where the personal computer 201 
and the pet-type robot 204 are connected with each 
other by infrared rays so as to enable transmission and 

so reception of the pet characteristic information via the 
personal computer 201 and the Internet 200. In Fig. 37, 
portions similar to those of Figs. 36 and 33 are denoted 
by the same numerals and will not be described further 
in detail. 

55 [0250] In the example of Fig.37, the personal com- 
puter 201 has an infrared transmission/reception port 
257, thus transferring to the Internet 200 the pet charac- 
teristic information transmitted from the pet-type robot 
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204 by using infrared rays and also transferring the pet 
characteristic information received via the Internet 200 
to the pet-type robot 204 by using infrared rays. 
[0251] Fig.38 shows the essential internal struc- 
tures of the personal computer 201 and the pet-type 
robot 204 in the case where the personal computer 201 
and the pet-type robot 204 are connected with each 
other by radio waves so as to enable transmission and 
reception of the pet characteristic information via the 
personal computer 201 and the Internet 200. In Fig.38, 
portions similar to those of Figs.36 and 34 are denoted 
by the same numerals and will not be described further 
in detail. 

[0252] In the example of Fig.38, the personal com- 
puter 201 has a radio transmission/reception section 
258, thus transferring to the Internet 200 the pet charac- 
teristic information transmitted from the pet-type robot 
204 by using radio waves and also transferring the pet 
characteristic information received via the Internet 200 
to the pet-type robot 204 by using radio waves. Specifi- 
cally, as the radio transmission/reception section 248 of 
the pet-type robot 204 and the radio transmis- 
sion/reception section 238 of the virtual electronic pet 
device 220, Bluetooth modules 248 and 238 can be 
used, respectively, as shown in Fig.39. The modules 
248 and 238 employ Bluetooth radio interfaces, as 
described above. 

[0253] Fig.40 shows the flow of transmission/recep- 
tion processing in the case where the virtual electronic 
pet device and the pet-type robot are connected with 
each other via a serial data cable, infrared rays, or radio 
waves, thus transferring the pet characteristic informa- 
tion. The example of Fig.40 shows the flow in the case 
of transferring the pet characteristic information from 
the virtual electronic pet device to the pet-type robot. 
[0254] in Fig.40, a connection request is issued, for 
example, from the pet -type robot. Specifically, the pet- 
type robot first transmits a connection request signal to 
the virtual electronic pet device (expressed as a porta- 
ble electronic pet in Fig.40), as indicated by TR1 in 
Fig.40. In this case, the connection request is issued 
from the pet-type robot for the following reason. That is, 
if the connection request can be issued both from the 
pet-type robot and the virtual electronic pet device, a 
switch for determining which side should issue the con- 
nection request must be provided both in the pet-type 
robot and in the virtual electronic pet device, and partic- 
ularly, providing such a switch in the pet-type robot is 
not desired in view of the design (i.e., it is desired that 
various switches are provided in a robot as a pet). How- 
ever, the present invention is not limited to this example. 
The connection request can also be issued from the 
side of the virtual electronic pet device, and can be 
issued either from the pet-type robot or from the virtual 
electronic pet device. 

[0255] Therefore, in the present embodiment, since 
it is decided to issue the connection request from the 
pet-type robot, the switch is not required. 



[0256] In this case, the connection request signal 
transmitted from the pet-type robot includes an owner- 
ship flag (OwnJIg), which is a flag indicating which of 
the pet-type robot and the virtual electronic pet device 

5 has the right of ownership of the pet characteristic infor- 
mation (that is, a flag indicating which of the pet-type 
robot and the virtual electronic pet device the soul 
resides in). In the present embodiment, the right of own- 
ership of the pet characteristic information is not pro- 

70 vided when the value of the ownership flag is 0 
(OwnJIg = 0), and the right of ownership of the pet 
characteristic information is provided when the value of 
the ownership flag is 1 (OwnJIg = 1). In the example of 
Fig.40, as an initial state, the value of the ownership flag 

7 5 of the pet-type robot is 0 (Ownjfg = 0) and the value of 
the ownership flag of the virtual electronic pet device is 
1 (Own_fig= 1). 

[0257] On receiving the connection request signal, 
the virtual electronic pet device compares its own own- 

20 ership flag (Own_flg = 1) with the ownership flag 
(OwnJIg = 0) included in the received connection 
request signal. When the value of the ownership flag of 
the received connection request signal and the value of 
its own ownership flag are different, the virtual elec- 
ts tronic pet device transmits a connection permission sig- 
nal to the pet-type robot, as indicated by TR2 in Fig.40. 
[0258] On receiving the connection permission sig- 
nal, the pet -type robot compares its own ownership flag 
(OwnJIg =0) with the ownership flag (OwnJIg = 1) 

30 included in the received connection permission signal. 
When the value of the ownership flag of the received 
connection permission signal and the value of its own 
ownership flag are different, the pet-type robot transmits 
a data request signal to the virtual electronic pet device, 

35 as indicated by TR3 in Fig.40. 

[0259] On receiving the data request signal, the vir- 
tual electronic pet device transmits the pet characteris- 
tic information stored therein to the pet-type robot, as 
indicated by TR4 in Fig.40. 

40 [0260] On receiving all the necessary pet charac- 
teristic information, the pet-type robot transmits a recep- 
tion completion signal to the virtual electronic pet 
device, as indicated by TR5 in Fig.40, and changes the 
value of its own ownership flag to 1 (OwnJIg = 1). 

45 [0261] On receiving the reception completion signal 
from the pet-type robot, the virtual electronic pet device 
changes the value of its own ownership flag to 0 
(OwnJIg = 0). In the above-described manner, the flow 
in the case of transferring the pet characteristic informa- 

50 tion from the virtual electronic pet device to the pet-type 
robot is completed. Thus, it is considered that the indi- 
vidual information storage section has been shifted to 
the pet-type robot. 

[0262] Fig. 41 shows the flow in the case of transfer- 
55 ring the pet characteristic information from the pet-type 
robot to the virtual electronic pet device. In the example 
of Fig. 41, as an initial state, the value of the ownership 
flag of the pet-type robot is 1 (OwnJIg = 1) and the 
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value of the ownership flag of the virtual electronic pet 
device is 0 (OwnJIg = 0). 

[0263] In Fig.41 , first, the pet-type robot transmits a 
connection request signal including the ownership flag 
to the virtual electronic pet device (expressed as a port- 
able electronic pet in Fig.41), as indicated by TR11 in 
Fig.41 . The value of the ownership flag in this case is 1 
(OwnJIg = 1). 

[0264] On receiving the connection request signal, 
the virtual electronic pet device compares its own own- 
ership flag (OwnJIg = 0) with the ownership flag 
(OwnJIg = 1) included in the received connection 
request signal. When the value of the ownership flag of 
the received connection request signal and the value of 
its own ownership flag are different, the virtual elec- 
tronic pet device transmits a connection permission sig- 
nal to the pet-type robot, as indicated by TR1 2 in Fig.41 . 
[0265] On receiving the connection permission sig- 
nal, the pet-type robot compares its own ownership flag 
(OwnJIg = 1) with the ownership flag (OwnJIg =0) 
included in the received connection permission signal. 
When the value of the ownership flag of the received 
connection permission signal and the value of its own 
ownership flag are different, the pet-type robot transmits 
the pet characteristic information stored therein to the 
virtual electronic pet device, as indicated by TR13 in 
Fig.41. 

[0266] On receiving all the necessary pet charac- 
teristic information, the virtual electronic pet device 
transmits a reception completion signal to the virtual 
electronic pet device, as indicated by TR14 in Fig.41, 
and changes the value of its own ownership flag to 1 
(OwnJIg = 1). 

[0267] On receiving the reception completion signal 
from the virtual electronic pet device, the pet-type robot 
changes the value of its own ownership flag to 0 
(OwnJIg = 0). In the above-described manner, the flow 
in the case of transferring the pet characteristic informa- 
tion from the pet-type robot to the virtual electronic pet 
device is completed. Thus, it is considered that the indi- 
vidual information storage section has been shifted to 
the virtual electronic pet device. 
[0268] Fig.42 shows the flow of communication in 
the case where the value of the ownership flag of the 
pet-type robot and the value of the ownership flag of the 
virtual electronic pet device are the same. In the exam- 
ple of Fig.42, as an initial state, the value of the owner- 
ship flag of the pet-type robot is 0 (OwnJIg = 0) and the 
value of the ownership flag of the virtual electronic pet 
device is also 0 (OwnJIg = 0). As the value of the own- 
ership flag of the pet-type robot and the value of the 
ownership flag of the virtual electronic pet device are 
the same, it is indicated that the pet-type robot and the 
virtual electronic pet device originally deal with different 
electronic pets and that transmission/reception of the 
pet characteristic information cannot be carried out. 
[0269] In Fig.42, first, the pet-type robot transmits a 
connection request signal including the ownership flag 



to the virtual electronic pet device (expressed as a port- 
able electronic pet in Fig.42), as indicated by TR21 in 
Fig.42. The value of the ownership flag in this case is 0 
(OwnJIg = 0). 

5 [0270] On receiving the connection request signal, 
the virtual electronic pet device compares its own own- 
ership flag (OwnJIg = 0) with the ownership flag 
(OwnJIg = 0) included in the received connection 
request signal. 

10 [0271] In this case, since the value of the ownership 
flag of the received connection request signal and the 
value of its own ownership flag are the same, the virtual 
electronic pet device transmits a reception completion 
signal to the pet-type robot, as indicated by TR22 in 

75 Fig.42. On receiving the reception completion signal, 
the pet-type robot ends the processing. 
[0272] Fig. 43 shows an exemplary data format of 
the above-described connection request signal, the 
connection permission signal, and the reception com- 

20 pletion signal. 

[0273] The connection request signal consists of 
the connection request ID, the number of communica- 
tion bytes, which the number of bytes used at the time of 
connection, and the ownership flag (OwnJIg) with its 

25 additional data, each of the connection request ID, the 
number of communication bytes and the ownership flag 
being represented by 4 bytes. 
[0274] The connection permission signal consists 
of the connection permission ID, the number of commu- 

30 nication bytes, and the ownership flag (OwnJIg) with its 
additional data, each being represented by 4 bytes. 
[0275] The reception completion signal consists of 
the reception completion ID, the number of communica- 
tion bytes, and the ownership flag (OwnJIg) with its 

35 additional data, each being represented by 4 bytes. 
[0276] In the above-described embodiment, it is 
possible to transmit and receive the pet characteristic 
information of the electronic pet, directly or via the Inter- 
net. In the present invention, it is also possible to man- 

40 age various types of information related to the electronic 
pet by a predetermined server 260 via the Internet 200. 
Hereinafter, this server is referred to as a pet shared 
server. 

[0277] Fig. 44 shows the conceptual structure of a 
45 network system in which the pet characteristic informa- 
tion of the virtual electronic pet device 202, the personal 
computer 201 , and the pet-type robots 204, 204 is man- 
aged by a pet shared server 260 via the Internet 200. 
[0278] In the case of this network system, the pet 
so shared server 260 is provided with a data storage sec- 
tion 261 which has a pet characteristic information stor- 
age section 262 for storing the pet characteristic 
information and a management information (shared 
server pet management information) storage section 
55 263 for electronic pets managed by the pet shared 
server 260. 

[0279] Fig. 45 shows the essential internal struc- 
tures of the virtual electronic pet device 220 and the pet- 
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type robot 204 in the case where the pet shared server 
260, the virtual electronic pet device 220 and the pet- 
type robot 204 are connected via the Internet 200. In 
Fig. 45, portions similar to those of the foregoing draw- 
ings are denoted by the same numerals and will not be 
described further in detail. 

[0280] In the example of Fig. 45, since the virtual 
electronic pet device 220 and the pet-type robot 204 
can be connected directly to the Internet 200, the virtual 
electronic pet device 220 and the pet-type robot 204 
include modems 239 and 249, respectively. Through the 
modems 239 and 249, it is possible to connect to the pet 
shared server 260 via the Internet 200 and to manage 
various types of data including the pet characteristic 
information by the pet shared server 260. 
[0281] As it is made possible to manage the pet 
characteristic information of the electronic pet by the pet 
shared server 260 via the Internet 200 as shown in 
Figs. 44 and 45, it is possible to cause the pet shared 
server 260 to manage the pet characteristic information 
of the electronic pet, for example, in the case where the 
owner is away from home for a business trip, that is, to 
leave the electronic pet to the pet shared server, and at 
the destination of the business trip, retrieve and play 
with the pet characteristic information from the server, 
as shown in Fig. 46. 

[0282] Specifically, in the example of Fig.46, at 
home before making a business trip, the pet-type robot 
is first connected to the Internet so as to access the pet 
shared server, as described in A of Fig.46. At this point, 
the value of the ownership flag of the pet-type robot is 1 
(OwnJIg = 1). When the value of the ownership flag is 
1, the pet-type robot automatically selects "leaving" for 
leaving the pet characteristic information to the server. 
Thus, the pet characteristic information is uploaded 
from the pet-type robot to the server. Since the individ- 
ual electronic pets left to the pet shared server must be 
distinguished, the specific ID and password stored in 
the ROM of the pet-type robot are simultaneously trans- 
ferred to the server in the uploading. 
[0283] Next, at the destination of the business trip, 
for example, a portable terminal (a portable virtual elec- 
tronic pet device or personal computer) is connected to 
the Internet so as to access the pet shared server, as 
described in B of Fig.46. At this point, a plurality of menu 
items are displayed in the image display section of the 
portable terminal (the image display section of the port- 
able virtual electronic pet device or the monitor of the 
personal computer). The menu items include "leaving", 
"receiving" and so on. In this case, "receiving" is 
selected. For receiving the electronic pet which the user 
left, the user enters the ID and password to prevent 
reception of a wrong electronic pet. After that, the pet 
characteristic information of the electronic pet left to the 
pet shared server is downloaded to the portable termi- 
nal. Thus, the user can keep the electronic pet on the 
portable terminal or play with the electronic pet even at 
the destination of the business trip. 



[0284] When returning from the destination of the 
business trip, for example, the portable terminal is con- 
nected to the Internet so as to access the pet shared 
server, as described in C of Fig.46. Thus, a plurality of 

5 menu items are displayed in the image display section 
of the portable terminal. As the user selects "leaving" of 
the menu items and enters the ID and password, the pet 
characteristic information is uploaded from the portable 
terminal to the server. 

10 [0285] After returning home from the business trip, 
the pet-type robot is connected to the Internet so as 
access the pet shared server, as described in D of 
Fig.46. At this point, the value of the ownership flag of 
the pet-type robot is 0 (OwnJIg = 0). When the value of 

is the ownership flag is 0, the pet-type robot automatically 
selects "receiving" for receiving the pet characteristic 
information from the server. Thus, the pet characteristic 
information is downloaded from the server to the pet- 
type robot. 

20 [0286] In the above-described second embodiment, 
the electronic pet is kept as the electronic pet on the vir- 
tual electronic pet device, the pet-type robot, and the 
personal computer. However, as a third embodiment of 
the present invention, it is also possible that the pet-type 
25 robot plays as an electronic pet 263 in a virtual world 
261 on the personal computer and that the user him- 
self/herself enters the virtual world 261 as an avatar 262 
and plays with his/her own electronic pet, as shown in 
Fig.47. The avatar is the incarnation of the god appear- 
so ing in the Indian mythology. In the virtual world drawn as 
two-dimensional or three-dimensional computer graph- 
ics, this avatar serves as a character representing the 
user. 

[0287] In the present embodiment, it is also possi- 

35 ble to let the avatar 262 of the user and his/her elec- 
tronic pet 263 enter a virtual world 260 which is 
constructed on the network and in which another avatar 
264 and his/her electronic pet 265 exist, and to let them 
communicate with each other. 

40 [0288] In the example shown in Fig.45, the virtual 
electronic pet device 220 and the pet-type robot 204 
can be connected to the Internet 200 via the modems 
239 and 249. However, the means for connection to the 
Internet is not limited to these modems. For example, 

45 connection can be made by Bluetooth modules, which 
are radio means. I n such a case, the pet-type robot 204 
and the virtual electronic pet device 220 have Bluetooth 
modules 249a and 239a, respectively, as radio trans- 
mission/reception sections, as shown in Fig. 48. Accord- 

50 ingly, Bluetooth modules 249b and 239b are connected 
to the Internet (e.g., public telephone network) and data 
transmission/reception is carried out with the Bluetooth 
module 249a of the pet-type robot 204 and the Blue- 
tooth module 239a the virtual electronic pet device 220. 

55 In this case, the Bluetooth modules 239a, 249a, 239b 
and 249b employ Bluetooth radio interfaces, as 
described above. 

[0289] Hereinafter, the structure and operation will 
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be described which are adapted for realizing the keep- 
ing of the electronic pet in a three-dimensional virtual 
space as in the third embodiment by using the WWW 
(world wide web) framework for providing various types 
of information via the Internet, which is a computer net- 
work constructed on the global scale, and by using 
VRML (virtual reality modeling language), which is a 
description language enabling unified handling of three- 
dimensional information. 

[0290] First, prior to the description of the third 
embodiment of the present invention, VRML will be 
briefly explained. 

[0291] VRML is a three-dimensional graphics 
description language which enables setting of links of 
hyper texts with respect to an object drawn by descrip- 
tion in the three-dimensional space or three-dimen- 
sional graphics and which enables sequential access to 
the WWW server while tracing these links. To display 
the three-dimensional space described in this VRML, 
VRML browser has been developed. The details of 
VRML are described, for example, in Mark Pesce, 
"VRML: Browsing & Building of Cyberspace", 1995, 
New Readers Publishing, ISBN 1-56205-498-8 (and its 
Japanese version, translated by Koichi Matsuda, Teru- 
taka Kamachi, Shoichi Takeuchi, Yasuaki Honda, 
Junichi Rekimoto, Masayuki Ishikawa, Ken Miyashita 
and Kazuhiro Hara, first edition published on March 25, 
1996), and Koichi Matsuda and Yasuaki Honda, "The 
Latest Trend of VRML and Cyber-Passage", bit 
(Kyoritsu Shuppan), 1996, VoL28, No. 7, pp.29 to 36; 
No.8, pp.57 to 65; No.9, pp.29 to 36; and No. 10, pp.49 
to 58. The official complete specification of the Vir- 
tual Reality Modeling Language Version 2.0, ISO/I EC 
CD 14772, August 4, 1996 is laid open to the public 
at "http://webspace.sgi.com/moving-worlds/spec/ 
index.html" and its Japanese version is laid open at 
" http ://w ww. webcity.co. j p/i nf o/a n d oh/V R M L/v rm 12 . 0/ 
spec-jp/index.html". Moreover, as the VRML 2.0 
browser and the shared server software, for example, 
the present Applicant, Sony Corporation has developed 
and produced "Community Place Browser/Bureau 
(trademark)", and its beta version (sample version) can 
be downloaded from the homepage "http//vs.sony.co.jp" 
on the Internet. 

[0292] In the case of building a three-dimensional 
virtual space using such VRML 2.0, a VRML file repre- 
senting desired contents is first prepared in accordance 
with the corresponding relation (routing) between the 
graphic data and the script, for example, preparation of 
the graphic data indicating the shape, motion, and posi- 
tion of an object (model) in the virtual space by using 
VRML (i.e., preparation of the model), addition, to the 
model, of a switch (sensor) which generates an event 
when the user clicks the mouse to point the model in the 
virtual space displayed on the screen (i.e., addition of 
the sensor), programming of the script for realizing the 
event generated in response to the pointing to the sen- 
sor (i.e., preparation of the script), and operation with 



respect to the sensor and starting of the script. (Herein- 
after, common nodes such as the graphic data, the 
script, and the right prescribed in VRML are also 
referred to as nodes, as a general term.) For example, 
5 how to write and sample data of VRML 2.0 are 
explained at "http://www.ses.co.jp/SES/STAFF/kan/ 
howto/howtol .html". 

[0293] The data of VRML 2.0 is constituted by a 
node and a field. The field provides a variable to the 

10 node and designates the parameter of the node. The 
field may be omitted. In the case where the field is omit- 
ted, a default value is used. As the field, a "single-value 
field (SF)" having only a single value or a "multiple-value 
field (MF)" may be employed. For the detailed function 

75 of the node and the field, "Appendix 1 : VRML 2.0 Node 
List" should be referred to. 

[0294] In VRML 2.0, a mechanism for realizing 
autonomic behavior in the VRML virtual space is pre- 
scribed. The details of the mechanism for autonomic 

20 behavior are disclosed in the paragraph of concepts in 
the specification 4. of the Virtual Reality Modeling Lan- 
guage Version 2.0, ISO/IEC CD 14772, August 4, 
1996, which is laid open to the public at "http://web- 
space.sgi.com/moving-worlds/spec/part1/con- 

25 cepts.html" and its Japanese version 
"http://www.webcity.co.jp/info/andoh/VRML/VRML2.0/ 
spec-jp/part1/concepts.html". In the paragraph, the key 
concepts for using the VRML specification are 
described. General items related to various nodes are 

30 described such as the method for coupling a node to a 
scene graph, the method in which a node generates or 
receives an event, the method for preparing a node type 
using a prototype, the method for adding a node type to 
VRML and exporting it so as to enable use from outside, 

35 and the method for incorporating a script operating as a 
program into the VRML file. 

[0295] Fig. 49 shows the specific structure of the 
network system according to the third embodiment. 
[0296] The constituent elements denoted by 

40 numerals 301, 302, and 303 in Fig.49 are client PCs, 
that is, the above-described personal computers in 
which a VRML browser and a WWW browser are 
installed and operating. These client PCs are connected 
to the Internet 307 via Internet connection service pro- 

45 viders 304, 305, and 306. 

[0297] To a LAN (local area network) 309 con- 
nected to the Internet 307 via a router 308, a WWW 
server 310, a WLS (world location server) 311, a pet 
shared server 312, AO servers 313, 314, a mail server 

so 315, and a communication server 31 6 are connected. In 
these servers 310 to 316, hard disks (HDDs) 310a, 
310b, 31 1a to 316a are provided, respectively. 
[0298] The communication server 316 is connected 
to a telephone set 318 and a facsimile 319 via a public 

55 telephone network 31 7. The communication server 31 6 
is also connected to a PHS (personal handyphone sys- 
tem) terminal 323 via a PHS service provider 320, and 
is connected through radio waves to a pager terminal 
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324 via a pager service provider 321 . 
[0299] Fig.50 is a block diagram showing the hard- 
ware structure of the client PC 301 of Fig. 49. 
[0300] In Fig.50, the client PC 301 is constituted by 
a CPU 330 for controlling each part, an HDD 331 in s 
which the VRML contents made up of a script program 
of a virtual life object by VRML 2.0 or Java (trademark) 
and the user data are stored, a CD-ROM drive 332 for 
reading the VRML contents stored on a CD-ROM disc 
333, a ROM 334 in which BIOS (basic input output sys- 10 
terns) and the like are stored, a sound processing circuit 
335 connected with a microphone 336 and left and right 
speakers 337, 338, a modem 339 for connecting to the 
Internet 307, an I/O (input/output) interface 340 con- 
nected with a mouse 341 and a keyboard 342, a graph- is 
ics processing circuit 343 having a VRAM 344 provided 
therein, a CRT monitor 345, and a RAM 346. At the time 
of execution, a WWW browser (e.g., Netscape Naviga- 
tor (trademark)) operating on an OS (e.g., Windows by 
Microsoft), an interpreter (e.g., Java interpreter), and a 20 
VRML 2.0 browser (e.g., Community place Browser 
developed by Sony Corporation) are read into the RAM 
346 so as to be executed by the CPU 330. 
[0301] In the VRML 2.0 browser, a syntax interpre- 
tation library (parser) of VRML (e.g., QvLib developed 25 
by Silicon Graphics of the U.S. and made open free of 
charge), and a software renderer (e.g., RenderWare 
produced by Criterion Software Ltd. of England) are 
provided. 

[0302] The VRML 2.0 browser of this client PC car- 30 
ries out transmission/reception of various types of data 
to/from the WWW browser (e.g., Netscape Navigator) 
on the basis of NCAPI (Netscape Client Application Pro- 
gramming Interface (trademark)), as shown in Fig.50. 
[0303] On receiving the HTML file and the VRML 35 
contents (including the VRML file and the script pro- 
gram) from the WWW server 310 via the Internet 307, 
the WWW browser stores these data into the local HDD 
331 . The WWW browser processes the HTML file of the 
received data and displays texts and images on the 40 
CRT monitor. On the other hand, the VRML browser 
processes the VRML file and displays a three-dimen- 
sional virtual space on the CRT monitor, and also 
changes the behavior of the object in the three-dimen- 
sional virtual space in accordance with the result of 45 
processing of the script program by the interpreter. 
[0304] Although not shown in the drawing, the other 
client PCs 302 and 303 are constituted similarly to the 
client PC 301. 

[0305] An exemplary operation of the system so 
shown in Fig. 49 will now be described. 
[0306] First, the procedures from the actual down- 
loading of the VRML contents via the Internet to the pro- 
vision of a multi-user environment in which a plurality of 
users share one virtual space will be described with ref- ss 
erence to Figs.51 to 53. 

[0307] As indicated by L1 in Fig. 51, the homepage 
of the website providing the VRML contents is first 



browsed by using the WWW browser. Then, the users of 
the client PC 301 and the client PC 302 download the 
VRML contents made up of the VRML 2.0 file and the 
script program (e.g., Java script program) for realizing 
autonomic behavior in the VRML space, as indicated by 
L2 in Fig.51 . Of course, the VRML contents provided on 
the CD-ROM 333 may be read by the CD-ROM drive 
332. 

[0308] Next, as shown in Fig.52, in the client PC 
301 and the client PC 302, the VRML browser interprets 
and executes the VRML 2.0 file, which is downloaded 
and temporarily stored on the local HDD 331 of the 
respectively client PCs. Moreover, the client PC 301 and 
the client PC 302 inquire the WLS 31 1 for the URL of 
the pet shared server 312 on the basis of the VSCP (vir- 
tual society server client protocol), as indicated by L3 in 
Fig.52. In this case, the WLS 311 notifies the client PC 
301 and the client PC 302 of the URL of the pet shared 
server 312 with reference to a shared server URL man- 
agement table stored on an HDD 31 1a, as indicated by 
L4 in Fig.52. 

[0309] Using the URL, the client PC 301 and the cli- 
ent PC 302 are connected to the pet shared server 31 2, 
as shown in Fig. 53. Consequently, transmission of a 
shared message related to the position and motion of a 
shared 3D (three-dimensional) object is carried out via 
the pet shared server 31 2, as indicated by L5 in Fig. 53, 
and transfer of the shared message is carried out, as 
indicated by L6 in Fig. 53, thus realizing a multi-user 
environment. 

[0310] In the multi-user environment thus realized, 
when log-in from the client PC 301, that is, from the 
user, is made, the pet shared server 312 transmits the 
data of the virtual shared world to the client PC 301 and 
transfers the data of the virtual life object in the AO 
server 313. 

[0311] On receiving the whole data of the virtual 
shared world and the data of the object in the virtual 
shared world, the client PC 301 records these data onto 
the internal hard disk or stores them into the internal 
memory, and then displays the virtual shared world on 
the monitor screen on the basis of the recorded data. 
[0312] In the case where the user enters his/her 
own avatar 262 and the electronic pet 263 into the vir- 
tual shared world at the client PC 301 , a call message is 
transmitted to the AO server 313 via the pet shared 
server 312. The AO server 313 executes parameter 
updating processing based on the access event. 
[0313] As another access event is executed, the 
operation message is transmitted to the AO server 313, 
and the parameter is updated every time an operation 
event is generated. 

[0314] For example, every time the parameter is 
updated, it is transferred to the client PC 301 and the 
other client PC 302 which shares the virtual space, by 
multi-cast processing of the pet shared server 31 2. 
[0315] In the client PC 301, the script program in 
which the processing procedure for controlling the auto- 
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nomic behavior of the electronic pet is described is exe- 
cuted on the basis of the parameter sent back thereto. 
The value of the field of each node constituting the 
three-dimensional object for expressing the electronic 
pet of the VRML file is changed. The electronic pet on 5 3. 
which the changed value of the field is reflected is ren- 
dered and displayed on the main window of the VRML 
browser on the screen of the image display section of 
the client PC 301. 4. 
[0316] The same processing as that of the client PC 10 
301 is executed in the other client PC 302 which shares 
the virtual world. Thus, the electronic pet on which the 
value of the field changed in accordance with the move- 5. 
ment of the electronic pet is reflected is rendered and 
also displayed on the main window of the VRML is 
browser on the image display section of the other client 
PC 302. 

[0317] For the details of the above-described con- 
nection procedure, the Japanese Publication of Unex- 
amined Patent Application No. Hei 9-81781 should be 20 6. 
referred to. 

[0318] In the present embodiment, the information 

providing medium for providing the computer program 

for executing the above-described processing includes 

a network transmission medium such as the Internet or 25 7. 

a satellite as well as an information recording medium 

such as a magnetic disk or a CD-ROM. 

Claims 

30 

1. An electronic pet system comprising: 8. 

an information processing device having trans- 
mission/reception means capable of transmit- 
ting and receiving the internal state of an 35 
electronic pet, which is changed in accordance 
with input information and is information for 9. 
causing the electronic pet to act, and image 
display means, the information processing 
device being adapted for carrying out process- 40 
ing for implementing the electronic pet by the 
image display means; and 
a robot having transmission/reception means 
capable of transmitting and receiving the inter- 
nal state of the electronic pet, which is changed 45 
in accordance with input information and is 
information for causing the electronic petto act, 
and a motion section for moving in the real 
world, the robot being adapted for controlling 
the motion section to carry out processing for 50 
implementing the electronic pet as an exist- 
ence in the real world. 

2. The electronic pet system as claimed in claim 1, 
wherein the information processing device and the 55 
robot have storage means in which the internal 
state is stored, and 



the internal state stored in the storage means 
is transmitted and received by the transmis- 
sion/reception means. 

The electronic pet system as claimed in claim 1, 
wherein the internal state indicates at least one of 
the state of the emotion and the state of the instinct. 

The electronic pet system as claimed in claim 1, 
wherein the input information is at least one of sur- 
rounding information and internal information. 

The electronic pet system as claimed in claim 1, 
wherein the internal state is an internal state 
parameter expressed by a parameter, and 

the internal state parameter is updated in 
accordance with the input information. 

The electronic pet system as claimed in claim 5, 
wherein when the internal state parameter has 
reached a threshold value, a predetermined action 
is selected and the action is actually carried out. 

The electronic pet system as claimed in claim 6, 
wherein when the internal state parameter has 
reached a threshold value, a plurality of actions are 
selected and one of the actions is actually carried 
out. 

The electronic pet system as claimed in claim 1, 
wherein the robot actually carries out an action 
based on the internal state via a posture or a 
motion to which the motion section can made tran- 
sition from the current posture. 

An electronic pet system comprising: 

an information processing device having radio 
transmission/reception means capable of 
radio-transmitting and receiving the interna! 
state of an electronic pet, which is changed in 
accordance with input information and is infor- 
mation for causing the electronic pet to act, and 
image display means, the information process- 
ing device being adapted for carrying out 
processing for implementing the electronic pet 
by the image display means; and 

a robot having radio transmission/reception 
means capable of radio-transmitting and 
receiving the internal state of the electronic pet, 
which is changed in accordance with input 
information and is information for causing the 
electronic pet to act, and a motion section for 
moving in the real world, the robot being 
adapted for controlling the motion section to 
carry out processing for implementing the elec- 
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tronic pet as an existence in the real world. object; 



10. The electronic pet system as claimed in claim 9, 
wherein the radio transmission/reception means of 
the information processing device and of the robot 5 
employ Bluetooth radio interfaces. 

11. The electronic pet system as claimed in claim 9, 
wherein the information processing device and the 
robot have storage means in which the internal w 
state is stored, and 

the internal state stored in the storage means 
is transmitted and received by the transmis- 
sion/reception means. 15 

12. The electronic pet system as claimed in claim 9, 
wherein the internal state indicates at least one of 
the state of the emotion and the state of the instinct. 

20 

13. The electronic pet system as claimed in claim 9, 
wherein the input information is at least one of sur- 
rounding information and internal information. 

14. The electronic pet system as claimed in claim 9, 25 
wherein the interna! state is an internal state 
parameter expressed by a parameter, and 

the internal state parameter is updated in 
accordance with the input information. 30 

15. The electronic pet system as claimed in claim 14, 
wherein when the internal state parameter has 
reached a threshold value, a predetermined action 

is selected and the action is actually carried out. 35 

16. The electronic pet system as claimed in claim 15, 
wherein when the internal state parameter has 
reached a threshold value, a plurality of actions are 
selected and one of the actions is actually carried 40 
out. 

17. The electronic pet system as claimed in claim 9, 
wherein the robot actually carries out an action 
based on the internal state via a posture or a 45 
motion to which the motion section can made tran- 
sition from the current posture. 

18. A network system comprising: 

50 

one or more implementation devices having 
transmission/reception means capable of 
transmitting and receiving the internal state of 
a living body object, which is changed in 
accordance with input information and is infor- 55 
mation for causing the living body object to act, 
and the identification information of the living 
body object, thus implementing the living body 



a server device having management means for 
managing the internal state of the living body 
object and the identification information of the 
living body object, and transmission/reception 
means capable of transmitting/receiving at 
least the internal state and the identification 
information; 

wherein the implementation devices and the 
server device are connected with each other 
via a network. 

19. The network system as claimed in claim 18, 
wherein the internal state of the implementation 
devices is stored in storage means, and 

the internal state stored in the storage means 
is transmitted and received by the transmis- 
sion/reception means. 

20. The network system as claimed in claim 18, 
wherein the implementation device is an informa- 
tion processing device for carrying out processing 
for implementing the living body object by image 
display means, or a robot which controls a motion 
section to carry out processing for implementing the 
living body object as an existence in the real world. 

21. The network system as claimed in claim 20, 
wherein the robot actually carries out an action 
based on the internal state via a posture or a 
motion to which the motion section can made tran- 
sition from the current posture. 

22. The network system as claimed in claim 18, 
wherein the internal state indicates at least one of 
the state of the emotion and the state of the instinct 

23. The network system as claimed in claim 18, 
wherein the input information is at least one of sur- 
rounding information and internal information. 

24. The network system as claimed in claim 18, 
wherein the internal state is an internal state 
parameter expressed by a parameter, and 

the internal state parameter is updated in 
accordance with the input information and the 
updated internal state parameter is stored into 
the storage means. 

25. The network system as claimed in claim 24, 
wherein when the internal state parameter has 
reached a threshold value, a predetermined action 
is selected and the action is actually carried out. 

26. The network system as claimed in claim 25, 
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wherein when the internal state parameter has 
reached a threshold value, a plurality of actions are 
selected and one of the actions is actually carried 
out. 

5 

27. A network system comprising: 

an implementation device having transmis- 
sion/reception means capable of transmitting 
and receiving the internal state of a living body 10 
object, which is changed in accordance with 
input information and is information for causing 
the living body object to act, thus implementing 
the living body object; and 
an information processing device having trans- 75 
mission/reception means capable of transmit- 
ting and receiving the internal state of the living 
body object, the information processing device 
controlling the action of the living body object 
acting in a virtual world on the basis of the 20 
internal state of the living body object, the infor- 
mation processing device carrying out process- 
ing for displaying at least the virtual world and 
the living body object; 

wherein information is transmitted and 25 
received between the implementation device 
and the information processing device via a 
network. 

28. The network system as claimed in claim 27, 30 
wherein the implementation device has storage 
means in which the living body object is stored, and 

the internal state stored in the storage means 
is transmitted and received by the transmis- 35 
sion/reception means. 

29. The network system as claimed in claim 27, 
wherein the implementation device and the network 
have radio transmission/reception means employ- 40 
ing a Bluetooth radio interface, respectively, and are 
connected to each other via radio waves so as to 
carry out transmission/reception of information. 

30. The network system as claimed in claim 27, 45 
wherein the implementation device is an informa- 
tion processing device for carrying out processing 

for implementing the living body object by image 
display means, or a robot which controls a motion 
section to carry out processing for implementing the 50 
living body object as an existence in the real world. 

31. The network system as claimed in claim 30, 
wherein the robot actually carries out an action 
based on the internal state via a posture or a 55 
motion to which the motion section can made tran- 
sition from the current posture. 



32. The network system as claimed in claim 27, 
wherein the internal state indicates at least one of 
the state of the emotion and the state of the instinct. 

33. The network system as claimed in claim 27, 
wherein the input information is at least one of sur- 
rounding information and internal information. 

34. The network system as claimed in claim 27, 
wherein the internal state is an internal state 
parameter expressed by a parameter, and 

the internal state parameter is updated in 
accordance with the input information. 

35. The network system as claimed in claim 34, 
wherein when the internal state parameter has 
reached a threshold value, a predetermined action 
is selected and the action is actually carried out. 

36. The network system as claimed in claim 35, 
wherein when the internal state parameter has 
reached a threshold value, a plurality of actions are 
selected and one of the actions is actually carried 
out. 

37. A robot adapted for storing the internal state of a liv- 
ing body object, which is changed in accordance 
with input information and is information for causing 
the living body object to act, and for controlling a 
motion section to carry out processing for imple- 
menting the living body object as an existence in 
the real world, 

wherein the robot transfers at least the inter- 
nal state to an information processing device, which 
controls the action of a living body object acting in a 
virtual world on the basis of the internal state of the 
living body object in the robot and carries out 
processing for displaying at least the virtual world 
and the living body object. 

38. The robot as claimed in claim 37, further compris- 
ing storage means in which the internal state is 
stored, 

wherein the internal state stored in the stor- 
age means is transferred. 

39. The robot as claimed in claim 37, wherein the inter- 
nal state indicates at least one of the state of the 
emotion and the state of the instinct. 

40. The robot as claimed in claim 37, wherein the input 
information is at least one of surrounding informa- 
tion and internal information. 

41. The robot as claimed in claim 37, wherein the inter- 
nal state is an internal state parameter expressed 
by a parameter, and 
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the internal state parameter is updated in 
accordance with the input information and the 
updated internal state parameter is stored into 
storage means. 

5 

42. The robot as claimed in claim 41 , wherein when the 
internal state parameter has reached a threshold 
value, a predetermined action is selected and the 
action is actually carried out. 

10 

43. The robot as claimed in claim 44, wherein when the 
internal state parameter has reached the threshold 
value, a plurality of actions are selected and one of 
the actions is actually carried out. 

15 

44. The robot as claimed in claim 37, wherein the robot 
actually carries out an action based on the internal 
state via a posture or a motion to which the motion 
section can made transition from the current pos- 
ture. 20 



45. A storage medium which is adapted for storing data 
usable in an information processing device and can 
be inserted to/ejected from a slot provided in the 
information processing device, 25 

the storage medium having indication means 
for indicating an accurate loading position 
when loaded in the slot of the information 
processing device. 30 



46. The storage medium as claimed in claim 45, 
wherein the internal state of a living body object, 
which is changed in accordance with input informa- 
tion and is information for causing the living body 35 
object to act, is stored, and 

the storage medium is loaded into the informa- 
tion processing device as an implementation 
device for implementing the living body object 40 
on the basis of the internal state of the living 
body object. 

47. The storage medium as claimed in claim 46, 
wherein the implementation device is an informa- 45 
tion processing device for carrying out processing 

for implementing the living body object as an elec- 
tronic pet by image display means, or a robot for 
carrying out processing for implementing the living 
body object as an electronic pet of an existence in so 
the real world. 
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